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Preface 


The  purpose  of  this  study  was  to  identify  specific  tactical 
airlifter  characteristics  that,  vrtien  improved,  produce  the  greatest 
improvement  in  tactical  airlift  capability.  This  was  done  by  carrying 
out  an  experiment  using  the  Generalized  Air  Mobility  Model,  a  canputer 
simulation  of  a  tactical  airlift  system.  This  model  allowed  the 
effectiveness  of  the  tactical  airlift  system  to  be  measured  as  airlifter 
characteristics  were  changed.  Characteristics  that  produced  significant 
changes  to  the  measures  of  effectiveness  were  then  identified. 

I  became  interested  in  this  topic  primarily  because  the  Royal 
Australian  Air  Force  has  been  considering  a  number  of  different  aircraft 
as  possible  replacement  tactical  airlifters.  Hiis  research  was  an 
attempt  to  identify  the  most  important  tactical  airlifter 
characteristics,  and  so  provide  some  insight  for  a  future  aircraft 
selection  process.  For  this  reason,  the  scenario  chosen  for  the 
experiment  was  Central  America.  Of  the  three  scenarios  available  to  use 
with  the  model,  the  Central  American  scenario  most  closely  matched  the 
environment  within  which  the  Australian  Defence  Force  might  possibly  be 
operating  in  a  future  conflict. 

I  wish  to  express  my  appreciation  to  my  advisor,  Maj  Paul  Auclair, 
for  his  continued  support  throughout  this  effort.  His  expertise, 
knowledge,  and  experience  in  operations  research  helped  me  many  times  in 
progressing  from  an  initial  formless  idea  to  the  final  product.  I  would 
also  like  to  thank  Steven  J.  Wourms  of  the  Directorate  of  Advanced 


Systems  Analysis,  DCS  for  Development  Planning,  Aeronautical  Systems 
Division  at  Wright -Patterson  AFB,  for  all  his  efforts  in  assisting  my 
research.  Stt  ^'s  knowledge  of  GAMM  and  his  expertise  in  aircraft 
analysis  were  invaluable  to  the  canpletion  of  this  research  project. 

Finally,  I'd  like  to  thank  my  wife,  Janine,  and  my  children, 

Alissa  and  Christopher,  for  their  patience  and  understanding  during  the 
many  days  and  nights  v^en  I  was  tied  to  my  desk  with  work. 

Paul  Pappas 
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Abstract 

This  study  used  computer  simulation  to  identify  which  tactical  airlifter 
characteristics  most  significantly  affected  tactical  airlift  capability 
in  a  given  scenario.  The  Generalized  Air  Mobility  Model  was  used  to 
simulate  a  tactical  airlift  system.  Aircraft  characteristics  within  the 
model  were  grouped  into  six  variables.  A  2^  twc  level  full  factorial 
experimental  design  was  used  to  assess  the  effect  of  changes  in  aircraft 
characteristics  on  the  effectiveness  of  the  tactical  airlift  system. 
Yate's  algorithm  was  used  to  identify  significant  terms  based  upon  the 
results  of  the  factorial  experiment.  These  significant  terms  were  used 
to  develop  a  parsimonious  regression  model  that  represented  the  response 
function  of  the  experimental  variables.  The  variables  remaining  in  the 
regression  model  represented  the  tactical  airlifter  characteristics  that 
most  significantly  affected  the  capability  of  the  tactical  airlift 
system.  Only  one  scenario  was  used  in  the  experiment:  Central  America. 
This  scenario  was  charac-t-erized  by  a  tropical  mountainous  environment, 
poor  infrastructure,  a  limited  number  of  major  airfields,  and  many  short 
unprepared  airfields.  Two  groups  of  tactical  airlifter  characteristics 
were  found  to  significantly  affect  capability  of  the  tactical  airlift 
system  in  this  scenario:  the  size  of  the  aircraft's  cargo’ bay,  and  the 
aircraft's  ability  to  operate  on  unprepared  surfaces. 


AN  ANALYSIS  OF  FIXED  WING  TACTICAL  AIRLIFTER  CHAEACTERISTICS 


USING  AN  INTRA-THEATER  AIRLIFT  COMPUTER  MODEL 

I .  Introduction 

In  the  Johnson -McConne 1 1  Agreement  of  1966,  the  responsibility  for 
all  fixed  wing  airlift  in  the  U.S.  Armed  Forces  was  given  to  the  U.S, 

Air  Force  (USAF),  and  so  the  Military  Airlift  Command  (MAC)  became  the 
primary  provider  of  airlift  for  the  Armed  Forces  (19:8).  MAC  has  two 
major  roles:  strategic  or  inter-theater  airlift,  and  tactical  or  intra¬ 
theater  airlift. 

Tactical  Airlift  in  the  USAF 

Strategic  airlift  involves  the  movement  of  personnel,  supplies  and 
equipment,  to,  from,  or  between  theaters  of  operations.  Tactical 
airlift  involves  such  movements  v;ithin  a  designated  theater  of 
operations.  Tactical  airlift  usually  involves  movement  over  much 
shorter  distances  than  strategic  airlift  (11:8). 

For  tactical  airlift,  the  USAF  defines  five  general  mission 
categories: 

1.  Deployment .  Deployment  is  the  movement  of  forces  to  their  initial 
area  of  operation  in  theater. 

2.  Employment .  Employment  is  the  movement  of  forces  around  a  theater 
after  of  their  initial  deployment. 

3.  Sustainment .  Sustainment  is  the  movement  of  replacement  personnel 
and  supplies  in  support  of  deployed  forces. 
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4. 


Retrograde .  Retrograde  is  the  use  of  aircraft  on  the  return  leg 


of  a  deployment  mission,  such  as  for  evacuees  or  enemy  prisoners 
of  v;ar. 

5.  Air  Evacuation.  Air  Evacuation  usually  requires  a  specially 
configured  aircraft  (18:8-9). 

In  MAC,  tactical  airlift  is  currently  carried  out  iDy  Lockheed 
C-130  Hercules  aircraft.  The  C-130S  will  soon  be  augmented  by  the 
introduction  of  the  McDonnell  Douglas  c-17.  While  the  C-17  will  have 
short  field  performance  similar  to  the  C-130,  it  is  not  intended  to 
replace  the  C-130.  The  C-17  was  designed  as  a  long  range,  heavy  lift 
cargo  transport.  It  is  intended  primarily  to  provide  inter-theater 
airlift  of  outsize  loads,  such  as  tanks  and  infantry  fighting  vehicles, 
directly  into  airfields  in  potential  conflict  areas  (12:467). 

The  Airland  Battle 

The  primary  objective  of  tactical  airlift  is  to  provide  the  user, 
v;hich  is  usually  the  Army,  v/ith  the  capability  to  carry  out  a  mission 
when  there  are  no  other  means  available  to  do  the  job.  One  of  the  most 
important  reasons  for  the  use  of  tactical  airlift  is  speed  of  response. 
Tactical  airlift  also  provides  the  Army  with  increased  mobility  without 
reliance  upon  Ground  Lines  Of  Communication  (GLOC) .  It  affords  a  degree 
of  manoeuver  that  may  otherwise  be  impossible  due  to  the  lack  of  roads, 
rail  lines  or  major  airfields  within  a  theater  of  operations  (1:161; 
18:5-6) . 

Since  the  U.S.  Army  formalized  the  Airland  Battle  doctrine,  the 
concept  of  the  battlefield  has  changed.  Instead  of  a  single  line  on  the 
map  designating  the  Forward  Line  Of  Troops  (FLOT),  the  Airland  Battle 
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will  consist  of  nonlinear  battlefields  with  sane  Army  units  carrying  out 
deep  attacks  on  second  echelon  units  v^iile  others  simultaneously  engage 
first  echelon  units  (7:3,8).  Those  units  carrying  out  the  deep  attacks 
will  be  heavily  dependent  on  tactical  airlift  for  the  initial  assault 
and  for  continued  resupply  because  the  Ground  Lines  Of  Communication 
will  be  either  nonexistent  or  uncertain  (11:6). 

The  Airland  Battle  will  require  tactical  airlift  to  operate  up  to 
and  beyond  the  PLOT  in  the  support  of  ground  forces.  This  environment 
v/ill  present  a  significantly  greater  threat  to  tactical  airlift 
operations  than  has  previously  existed.  The  increased  threat  highlights 
the  vulnerability  of  the  C-130,  which  was  designed  with  a  wet  wing  and 
has  no  provision  for  radar  warning  receivers,  electronic  countermeasure 
pods  or  flare/chaff  dispensers.  (13:43-44) 

General  Issue 

The  C-130  aircraft  is  the  backbone  of  intra-theater  tactical 
airlift  for  the  U.S.  Armed  Forces  and  the  military  forces  of  57 
countries  around  the  world.  Over  1800  C-130  aircraft  have  been  produced 
(12:446)  . 

The  original  C-130  v/as  designed  to  a  specification  issued  by  the 
U.S.  Tactical  Air  Command  (TAC)  in  1951  (12:446).  With  the  exception  of 
a  number  of  C-130S  that  have  undergone  a  stretch  modification  of  their 
fuselages  to  increase  the  size  of  the  cargo  bay,  most  C-I30s  flying 
today  have  essentially  the  same  tactical  airlift  capabilities  as  the 
original  C-130A  aircraft. 

Even  though  it  is  still  an  effective  tactical  airlifter,  the  C-130 
is  based  on  a  40  year  old  design  that  did  not  anticipate  recently 
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developed  requirements.  The  adoption  of  the  Airland  Battle  doctrine  by 
the  U.S.  Army  has  significantly  changed  the  environment  within  which 
tactical  airlift  v;ill  be  operating.  A  tactical  airlifter  suited  to  the 
demands  of  the  new  battlefield  environment  should  be  considered  to 
replace  the  C-130.  It  should  incorporate  survivability  and 
vulnerability  improvements  to  successfully  operate  in  the  modern 
tactical  environment,  and  use  new  technology  to  improve  upon  the  C-130's 
tactical  airlift  capabilities.  However,  i-^ile  the  developnent  of  a 
replacement  for  the  C-130  was  discussed  by  the  National  Military  Airlift 
Subcommittee  of  the  U.S.  House  Armed  Services  Committee  as  long  ago  as 
1970,  no  replacement  for  the  C-130  is  currently  available  (13:44). 

Before  a  nev;  aircraft  can  be  designed,  an  assessment  of  tactical 
airlift  requirements  and  capabilities  is  required.  "Looking  back  at  the 
state  of  mobility  analysis  in  1983,  there  was  a  glaring  imbalance 
betv/een  our  ability  to  evaluate  strategic  mobility  systems  and  our 
ability  to  assess  tactical  mobility  requirements  and  capabilities" 
(6:2-2) . 

The  1931  Congressional ly  Mandated  Mobility  Study  (CMMS)  was  able 

to  define  strategic  deployment  requirements  and  set  a  mandated  minimum 

strategic  airlift  capability  of  66  million  ton  miles  per  day.  However, 

no  similar  target  was  defined  for  tactical  airlift.  In  order  to  iDetter 

define  tactical  airlift  requirements,  two  major  studies  were  begun  in 

1983:  the  Qualitative  Intra- theater  Airl i ft  Requirements  Study  (QITARS) 

and  the  Vforldwide  Intra-theater  Mobility  Study  (WIMS)  (11:7). 

QITARS,  completed  in  1985,  defines  wartime  missions  that  support 
AFM  1-1,  the  basic  airlift  doctrine  of  deployment,  employment  and 
sustainment  of  combat  forces,  v/iiis,  completed  in  1988,  defines 
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the  requirements  for  all  modes  of  transportation  within  a  theater 
that  includes  airlift.  (11:7) 

Both  studies  concluded  that  there  was  a  significant  shortfall  in 
existing  intra-theater  airlift  capability  (11:7). 

To  better  define  tactical  airlift  capabilities,  the  USAF 
Aeronautical  Systems  Division  (ASD)  initiated  the  Advanced  Transport 
Technology  Mission  Analysis  (ATIMA)  project  in  1986.  The  primary  aim  of 
the  ATIMA  project  was  to  investigate  the  relative  merits  of  new  tactical 
air  lifter  concepts.  The  evaluation  was  iDased  upon  a  number  of  different 
aircraft  options  including  "short  ta]<.eoff  and  landing  (STOL),  very  short 
takeoff  and  landing  (VSTOL),  and  low  observable  systems  including  large, 
medium,  and  small  cargo  compartments  (relative  to  the  current  C-130 
aircraft)"  (20:8) . 

A  number  of  new  system  concepts  have  been  developed  and  continue 
to  be  evaluated  as  a  result  of  the  ATO-IA  project.  In  addition,  a 
deficiency  analysis  of  the  C-130  was  carried  out  as  part  of  the  ATTMA 
project  to  determine  hov;  changes  to  individual  C-130  characteristics 
affected  tactical  airlift  capability  (24). 

Problem  Statement 

Although  the  ATTTIA  deficiency  analysis  looked  at  a  number  of 
individual  characteristics  and  combinations  of  characteristics,  a  full 
analysis  of  tactical  airlift  aircraft  characteristics  has  never  been 
carried  out.  Such  an  analysis  would  determine  which  specific 
characteristics  or  combination  of  characteristics  of  the  C-130  most 
significantly  affect  its  tactical  airlift  capability. 
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Research  Question 


What  specific  set  of  tactical  airlifter  characteristics  result  in 
the  greatest  improvement  in  tactical  airlift  capability? 

Research  Objective 

The  primary  objective  of  this  research  will  be  to  use  computer 
simulation  to  investigate  how  changes  to  specific  aircraft 
characteristics  affect  tactical  airlift  capability,  given  a  specific 
theater  of  operations  and  a  specified  set  of  tactical  airlift 
requirements.  Answers  to  the  follov;ing  questions  will  be  sought: 

1.  How  is  the  tactical  airlift  capability  of  fixed  wing  aircraft 
measured? 

2.  VJhat  individual  aircraft  characteristics  significantly  affect 
tactical  airlift  capability  when  changed? 

3.  v/hat  coiT±)tnation  of  aircraft  characteristics,  when  changed, 
results  in  the  greatest  improvement  in  tactical  airlift 
capabi I ity? 


Scope 

The  scope  of  this  research  will  be  limited  to  a  study  of  the 
capabilities  of  the  tactical  airlift  assets  using  the  scenario  described 
in  Chapter  III.  Although  changes  from  the  original  scenario  v;ill  be 
discussed,  no  analysis  or  validation  of  the  scenario  is  intended. 

Summary 

This  chapter  has  defined  the  role  of  tactical  airlift  in  the  USAF 
and  the  importance  of  the  C-130  to  that  role.  It  highlighted  the 
fundamental  rea.son  for  a  C-130  replacement:  its  <10  years  old  design  did 
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not  anticipate  the  demands  of  the  modern  tactical  operating  environment 
associated  with  the  U.S.  Army's  Airland  Battle  concept. 

This  chapter  also  listed  previous  studies  related  to  tactical 
airlift  capabilities  and  requirements.  It  noted  that  no  previous  study 
had  undertaken  a  full  analysis  of  aircraft  characteristics  and  their 
effect  on  tactical  airlift  capability.  The  research  objectives  outlined 
will  assist  in  identifying  v^ich  characteristics  significantly  affect 
tactical  airlift  capability. 
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II .  Background 


A  variety  of  measures  of  effectiveness  have  been  used  by  MAC  and 
by  previous  tactical  airlift  studies  to  assess  the  capability  of 
tactical  airlifters.  In  this  chapter,  these  measures  of  effectiveness 
will  be  reviewed.  In  addition,  a  summary  of  the  most  recent  USAF  study 
of  tactical  airlift  capability,  the  ATITIA  project,  will  be  presented. 

Measures  of  Effectiveness 

The  current  measures  that  MAC  uses  to  determine  the  capability  and 
effectiveness  of  its  tactical  airlifters  are  the  same  measures  used  to 
measure  the  capability  and  effectiveness  of  its  strategic  airlift 
aircraft.  Specifically,  the  MAC  measures  are: 

1.  Tons  of  cargo  moved  within  a  certain  period,  such  as  tons  per  day, 

2.  Average  aircraft  flying  time  per  day,  which  is  also  called 
utilization  rate  (UTE  Rate), 

3.  Departure  reliability,  that  is,  being  able  to  depart  on  a 
scheduled  departure  time,  and 

4.  The  number  of  hours  flovm  to  hours  scheduled  to  be  flown  (5:4). 
Many  previous  studies  have  indicated  that  these  measures  are  not 

very  useful  in  measuring  either  the  capability  or  effectiveness  of 
tactical  airlift  (5:3-5;  15:22;  18:22;  24:Sec  3.1  1-2). 

Of  the  five  general  missions  of  tactical  airlift,  only  sustainment 
involves  the  movement  of  bulk  cargo.  The  other  missions  are  primarily 
concerned  v;ith  the  movement  of  personnel  and  rolling  stock  (18:9).  Tons 
per  day  is  not  a  very  useful  indicator  of  the  effectiveness  of  tactical 
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airlift.  Operational  limitations  often  require  missions  to  be  flovm 
with  half  empty  aircraft  (18:22).  In  fact,  the  WIMS  study  found  that 
for  tactical  transport  in  general,  "tons  per  day  was  not  an  adequate 
measure  of  requirements  or  capabilities  for  any  mode"  (15:22). 

DTE  rates  are  also  a  poor  measure  of  tactical  airlift 
effectiveness  because  tactical  airlift  missions  are  "characterized  by 
multiple  sorties  of  short  range  and  duration,  leading  to  low  daily 
aircraft  utilization  rates"  (11:7). 

The  current  measures  of  tactical  airlift  capability  used  by  MAC 
are  primarily  efficiency  measures  that  do  not  take  into  consideration 
the  ability  of  tactical  airlift  to  meet  the  user's  needs.  "The  fact 
that  tactical  requirements  are  often  determined  by  the  user  as  a  result 
of  changing  combat  situations  makes  response  to  these  requests  more 
important  than  the  need  to  efficiently  use  the  aircraft"  (5:5). 

A  number  of  studies  have  tried  to  produce  a  better  set  of  measures 
of  tactical  airlift  capability.  VilMS  divided  the  requirements  of  the 
intra-theater  workload  into  three  categories,  according  to  the  items 
being  carried,  with  each  category  having  its  ovm  measure: 

1.  Dry  Cargo:  tons;  ton-miles, 

2.  Petrol,  Oil  and  Lubricants  (POL):  barrels;  barrel -mi les,  and 

3.  Passengers:  passengers;  passenger -mi les  (15:19). 

V/argaming  simulations  carried  out  by  LTV's  Mission  Analysis  Center 
and  the  McDonnell  Douglas  Aircraft  Company  considered  that  the 
effectiveness  of  tactical  airlift  could  only  be  measured  by  assessing 
the  overall  force  effectiveness  in  a  given  scenario  (14:1).  Some  of  the 
measures  that  were  used  to  assess  force  effectiveness  included: 
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1. 


the  size  of  the  surviving  and  attrited  forces, 
the  relative  combat  povjer  between  the  two  opposing  forces, 

3.  the  depth  of  penetration  and  ground  lost  or  taken,  as  measured  by 
the  Forward  Line  of  Troops  (FLOT),  or 

4.  a  record  of  objectives  achieved  (14:17). 

This  type  of  study  required  that  a  specific  scenario  be  simulated, 
and  the  results  recorded.  Subsequent  simulations  of  the  same  scenario 
using  different  tactical  airlift  forces  would  produce  different  results 
(14:18-27).  The  differences  in  the  results  could  then  be  attributed  to 
changes  in  the  composition  of  the  tactical  airlift  forces. 

The  ATITIA  project  also  used  a  computer  simulation  to  "analyze  the 
effectiveness  of  airlifters  in  representative  theater  airlift  wartime 
scenarios"  (24:Sec  3.1  1).  The  ATTMA  analysts  determined  that  tons  per 
day  and  ton-miles  per  day  were  not  suitable  measures  of  effectiveness 
for  intra-theater  airlift,  and  that  "theater  effectiveness  is  much  more 
a  function  of  timeliness,  quantity,  and  survivability  of  cargo" 

(24: Sec  3.1  2).  A  number  of  measures  were  used  in  the  ATIMA  project  to 
assess  the  effectiveness  of  tactical  airlift,  including  UTE  Rate,  tons 
delivered,  tons  delivered  on  time,  delivery  time,  productivity,  and 
aircraft  attrition  (24:Sec  3.1  3). 

The  Advanced  Transport  Technology  Mission  Analysis  (ATIT'IA) 

The  ATTtlA  project  was  the  most  canprehensive  analysis  of  tactical 
airlift  capability  ever  carried  out  by  the  USAF.  Its  purpose  was  to 
"support  Headquarters,  Military  Airlift  Command  (MAC)  in  developing  data 
to  support  the  preparation  of  a  Statement  of  Operational  Need  for  its 
next  generation  tactical  airlifter"  (20:1).  The  project  developed 
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a  comprehensive  database  highlighting  system  needs,  technology 
opportunities,  and  potential  solution  concepts;  an  evaluation  of 
those  solution  concepts  which  were  developed;  and  a  technology 
development  plan  cap^le  of  allowing  the  timely  development  of  the 
identified  concepts.  (20:2) 

T^ie  project  began  with  "an  extensive  needs  analysis  that  evaluated 
the  baseline  force  of  intra-theater  airlift  performing  representative 
jobs  in  likely  environments  containing  projected  threat  and  defined 
infrastructure"  (20:4).  The  likely  environments  were  developed  into 
three  descriptive  scenarios,  Europe,  Southwest  Asia  and  Central  America, 
with  each  scenario  representing  significantly  different  threat  levels, 
infrastructure,  airlift  tasks  and  geographical  regions. 

As  mentioned  previously,  the  main  tool  used  to  carry  out  the 
required  analysis  was  a  computer  simulation.  Prior  to  ATIMA,  there  were 
two  main  computer  models  that  represented  intra-theater  airlift:  the 
Tactical  Airlift  System  Ccmparitive  Analysis  Model  (TASCAM)  and  the 
Scenario  Unrestricted  Mobility  Model  for  Intra-theater  Simulation 
(SUI'MITS).  TASCAM  was  designed  to  represent  the  intra-theater  airlift 
logistics  system  and  considered  "maintenance  problems,  available  ramp 
space,  on/offload  times,  and  scheduled  airlift  based  on  priorities" 
(5:9).  SUMMITS  is  an  intra-theater  scheduling  model  that  was  used 
extensively  in  WIMS  to  determine  intra-theater  airlift  requirements 
( 15:13) . 

Neither  of  these  models  were  suitable  for  the  analysis  required  to 
be  carried  out  in  ATTMA  and  so  a  new  model  was  developed:  the 
Generalized  Air  Mobility  Model  (GAMM) .  GAMM  was  designed  to  model  a 
tactical  airlift  system,  and  focuses  on  the  movement  of  tactical  airlift 
loads  from  source  to  destination.  By  contrast,  in  wargaming  simulations 
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such  as  those  carried  out  by  the  LTV  Mission  Analysis  Center,  the 
tactical  airlift  system  is  one  of  many  factors  influencing  the  overall 
outcome.  GAMM  measures  the  effectiveness  of  a  tactical  airlift  system 
to  meet  the  operational  requirements  of  a  given  scenario.  It  does  not 
purport  to  assess  the  outcome  of  a  campaign  based  on  tactical  airlift  or 
any  other  factor  (17:1). 

The  initial  analysis  carried  out  using  GAI-IM  was  th®  assessment  of 
a  baseline  tactical  airlift  force,  consisting  of  a  mixed  fleet  of  C-I30s 
and  C-17s,  in  each  of  the  three  theaters.  Once  the  baseline  force  had 
been  evaluated,  a  deficiency  analysis  was  carried  out.  The  deficiency 
analysis  was  intended  to  identify  .specific  C-130H  airl i fter-related 
problems  that  prevented  the  tactical  airlift  system  from  achieving  the 
required  level  of  throughput  (24:Sec  3.4  1).  The  majority  of  the  runs 
for  the  deficiency  analysis  v/ere  carried  out  by  changing  either  one  or 
tv/o  characteristics  of  the  C-130H  at  a  time  and  then  assessing  hovi  these 
changes  affected  the  throughput  of  the  airlift  system.  In  addition,  a 
small  number  of  runs  were  carried  out  where  six  to  eight  C-130H 
characteristics  v;ere  dramatically  and  simultaneously  improved. 

The  deficiency  analysis  concluded  that,  for  the  Central  American 
scenario,  a  single  significant  problem  existed  with  the  C-130H:  its  poor 
landing  gear  performance  limited  the  aircraft's  ability  to  use  the  many 
unprepared  airfield.^  available  in  that  region  (24:Sec  3.4  49).  For  the 
European  and  Southv/est  Asian  scenarios,  the  conclusions  v;ere  that  "no 
single  deficiency  exists  for  the  C-130H,  which  if  corrected,  would  make 
a  dramatic  improvement  in  the  ...  airlift  .system's  effectiveness” 


(24: Sec  3.4  18,33 


In  all  three  scenarios,  the  greatest  improvements  in  system 
effectiveness  were  achieved  by  the  "super  planes"  vAiich  had  six  to  eight 
characteristics  dramatically  improved  (24:Sec  3.4  18,33,49), 

Summary 

This  chapter  reviewed  the  measures  of  effectiveness  that  have  been 
used  to  assess  the  capability  of  tactical  airlift.  While  most  of  the 
tactical  airlift  studies  carried  out  agree  that  the  measures  used  by  MAC 
are  not  suitable,  there  is  no  consensus  as  to  which  measures  are  more 
useful . 

In  addition,  this  chapter  briefly  reviewed  the  ATIMA  project,  and 
the  deficiency  analysis  that  was  carried  out  as  part  of  ATIMA.  The 
conclusions  of  the  deficiency  analysis  were  that,  with  the  exception  of 
the  landing  gear  limitation  in  Central  America,  there  was  no  single 
deficient  characteristic  of  the  C-130,  w*^ich,  if  corrected,  could 
sigriif icantly  improve  the  airlirt  system's  effectiveness.  However,  by 
dramatically  improving  six  to  eigh-  characteristics  at  the  same  time,  a 
significant  improvement  could  be  achieved. 
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III.  Generalized  Air  Mobility  Model  Overview 


Intrcaduction 

The  purpose  of  this  research  is  to  identify  v^ich  characteristics 
of  tactical  airlift  aircraft  are  of  greatest  importance  in  determining 
tactical  airlift  capability. 

This  cannot  be  done  by  an  analysis  of  past  cam'^igns  because  each 
campaign  had  distinctly  different  tactical  airlift  requirements  that 
were  determined  by  the  geographical  location  of  the  campaign  and  the 
intensity  of  the  combat  during  the  canpaign.  In  addition,  the 
significant  differences  in  aircraft  performance  between  tactical 
airlifters  used  in  past  campaigns  confound  any  attempt  to  isolate  the 
effect  of  individual  aircraft  characteristics  on  the  efficacy  of 
tactical  airlift  during  any  particular  campaign. 

similarly,  the  capabilities  of  individual  tactical  airlift 
aircraft  cannot  be  used  to  determine  how  effective  those  aircraft  will 
be  as  part  of  a  tactical  airlift  system  in  a  given  situation. 

Performance  measures,  such  as  the  amount  of  cargo  or  the  number  of  fully 
equipped  troops  that  can  be  carried,  only  define  the  limits  of  an 
aircraft's  capabilities.  Tactical  airlift  requirements  and  the 
operational  limitations  of  a  given  scenario  are  not  taken  into  accoiont 
by  aircraft  characteristics. 

However,  by  using  computer  simulation  to  model  a  tactical  airlift 
system  with  a  given  set  of  tactical  airlift  requirements,  it  may  be 
possible  to  identify  hcA'’  changes  in  aircraft  characteristics  can  affect 
tactical  airlift  capability  for  a  particular  scenario  or  setting.  Three 
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major  tactical  airlift  models  have  already  been  mentioned:  TASCAM, 
SUMMITS  and  GAl^.  Of  these,  only  GAMM  has  sufficient  fidelity  to 
evaluate  the  effects  of  changes  in  tactical  airlifter  characteristics. 

The  Generalized  Air  Mobility  Model  (GftMM) 

GAMM  was  developed  by  the  General  Research  Corporation  (GRC)  for 
the  Directorate  of  Advanced  Systems  Analysis,  ASD/XEM,  Aeronautical 
Systems  Division  at  Wright -Patterson  Air  Force  Base. 

The  GAMM  program  operates  on  Digital  Equipment  Corporation  (DEC) 
MicroVAX  II  computers  that  have  at  least  6  Megabytes  of  RAM  and  50 
Megabytes  of  disk  storage  capacity.  The  program  was  written  using 
Simscript  II. 5  and  FORTRAN  77  (DEC  Version  4.4)  (9:Sec  1-5). 

GAMM  is  a  "Monte-Carlo  simulation  of  an  airlift  transportation 
system"  (9:Sec  1-3)  that 

simulates  the  movement  of  cargo  by  an  intratheater  airlift  system. 
It  requires  information  concerning  the  cargo  to  be  moved,  the 
transportation  system  network,  and  the  characteristics  of  the 
airlifters  to  be  used  ...In  addition  to  airlifter  flights,  GAMM 
simulates  airlifter  ground  operations,  airdrops,  movanent  of  cargo 
by  Army  trucks  and  the  survivability/ vulnerability  of  the  cargo  in 
its  various  modes  of  transportation.  (17:1) 

As  part  of  the  ATIMA  project,  GAMM  has  been  used  for  the 

deficiency  analysis  of  the  C-130H  airlifter  mentioned  previously,  and  is 

currently  being  used  by  ASD/XRM,  MAC  and  three  airlifter  airframe 

contractors  for  the  evaluation  of  "conceptual  airlifter  designs"  (17:1). 

GAMM  Simulation  Elements 

There  are  four  major  elements  to  the  GAMM  simulation:  the 
airlifters,  the  airlift  jobs,  the  airbases,  and  cargo  entry/del ivery 
(E/D)  sites.  Each  of  these  elements  is  discussed  below. 
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Airllfter  Definition.  The  airlifters  used  in  the  simulation  are 


defined  by  69  parameters.  These  parameters  include  takeoff  and  landing 
performance,  cargo  compartment  size,  reliability  and  maintainability, 
ground  operation  factors  and  attrition  factors  (9:Sec  2-5  to  2-8). 

An  example  of  the  baseline  C-130H  model  parameters  is  contained  in 
i^pendix  A. 

Airlift  Jobs.  Each  airlift  job  defines  the  type  and  amount  of 
cargo  that  is  required  to  be  moved  by  the  transportation  system.  The 
specifications  for  the  jobs  carried  out  within  the  Central  American 
scenario  are  contained  in  ^^ipendix  B  (22:Sec  4-8).  In  addition  to  a 
description  of  the  individual  movement  items,  the  airlift  job  contains 
the  details  of  the  E/D  sites,  entry  and  delivery  times  and  the  job 
priority  (9:Sec  2-9). 

Airbases.  Airbases  in  GAMM  are  defined  by  their  geographic  and 
physical  characteristics  such  as  latitude  and  longitude,  elevation,  and 
runway  length,  and  also  by  airbase  attack  characteristics  such  as  the 
number  of  attacks  on  the  airbase  per  day  (9:Sec  2-9  to  2-12). 

Entry/Del ivery  (E/D)  Sites.  Airlift  jobs  originate  or  terminate 
at  an  E/D  site.  E/D  sites  are  typically  linked  to  a  number  of 
airfields.  The  links  define  the  transhipment  time  and  order  of 
preference  between  the  E/D  site  and  each  of  the  associated  airfields 
(9:Sec  2-12) . 

The  information  about  these  elements  is  contained  in  two  input 
files  that  are  required  tsy  GAMM  in  order  to  run  a  simulation.  Airlifter 
characteristics,  airbase  characteristics  and  the  E/D  site  information  is 
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contained  in  a  scenario  file.  All  the  airlift  jobs  are  contained  in  a 
jobs  file. 

Cargo  Movement  Within  GAMM.  GA^W  represents  the  movement  of 
cargo  fron  an  airlift  job  in  the  following  manner.  Cargo  enters  the 
simulation  at  an  entry  site  and  is  then  moved  along  a  transshipment  arc 
to  an  originating  airbase.  If  no  aircraft  are  available,  the  cargo 
awaits  the  arrival  of  an  aircraft.  When  an  aircraft  is  available,  the 
cargo  is  transported  to  a  receiving  airbase.  The  cargo  is  then 
transshipped  to  the  delivery  site.  This  is  represented  in  Figure  1. 


Figure  1.  GAMM's  Transportation  System  (9:Sec  3-1) 


The  movement  of  cargo  along  transhipment  arcs  is  not  modeled  with 
great  accuracy  in  GAMM  (9:Sec  3-7).  For  each  link,  the  transport  mode 
used  for  cargo  transhipment  is  defined  by  specifying  the  travel  time 
that  it  takes  the  cargo  to  move  along  the  transhipment  link.  As  well  as 
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the  actual  movement  time,  the  travel  time  also  includes  the  time  it 
takes  to  prepare  cargo  for  transhipment,  and  the  time  to  load  and  unload 
the  cargo  using  the  predetermined  transport  mode  (9:Sec  3-8).  If 
transhipment  is  carried  out  primarily  by  helicopters,  then  the  travel 
time  will  reflect  the  total  transit  time  required  to  move  the  cargo  by 
helicopter.  If  transhipment  is  primarily  by  trucks,  then  the  travel 
time  will  be  set  accordingly. 

GAMM  assumes  that  there  is  always  a  sufficient  suRJly  of  transport 
equipment  available  to  move  the  cargo  along  the  transhipment  links.  Any 
blockages  or  significant  delays  that  occur  in  delivering  caurgo  will  be 
due  to  bottlenecks  or  limitations  of  the  air  transport  system,  and  will 
not  be  caused  by  limitations  in  the  transhipment  phase. 

GAMM  Simulation  Overview 

The  GAMM  simulation  begins  with  all  airlifters  at  their  hcsne 
bases.  As  airlift  jobs  enter  the  simulation,  a  scheduling  algorithm 
begins  to  schedule  airlifters  for  missions,  initially  scheduling  airlift 
jobs  frcan  originating  airbases  that  have  airlifters  available.  Once  all 
these  jobs  have  been  scheduled,  the  scheduler  relocates  remaining 
airlifters  to  airbases  that  have  a  backlog  of  jobs  and  either 
insufficient  or  no  airlift  capacity  available  (9:Sec  3-2). 

For  each  originating  airbase,  airlift  jobs  can  be  scheduled  to 
depart  either  according  to  the  highest  priority  or  according  to  the 
largest  weight  of  cargo.  There  are  nine  priority  levels,  1  to  9,  with 
priority  level  l  being  the  highest,  if  a  priority  scheduling  factor  is 
set  during  the  initialization  of  the  simulation  run,  all  jobs  with  a 
priority  level  higher  than  this  factor  will  be  scheduled  in  order  of 
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their  priority.  All  other  jobs  will  be  considered  of  equal  priority, 
and  will  be  scheduled  according  to  their  weight.  If  no  priority 
scheduling  factor  is  set,  all  jobs  will  be  scheduled  according  to  their 
weight  {9:Sec  3-2). 

In  a  similar  manner,  if  a  priority  scheduling  factor  has  been  set, 
aircraft  are  relocated  to  originating  airbases  with  the  highest  priority 
jobs.  If  all  available  airlift  jobs  have  a  priority  less  than  or  equal 
to  the  priority  scheduling  factor,  or  if  no  factor  is  set,  aircraft  are 
relocated  to  the  airbase  that  has  the  largest  backlog,  by  weight,  of 
cargo  (9:Sec  3-2). 

Before  an  aircraft  is  loaded,  the  program  checks  the  airfields 
associated  with  the  delivery  site  of  the  job,  in  order  to  determine 
which  airfield  can  be  used  by  the  airlifter,  and  hew  much  cargo  can  be 
carried  into  that  airfield.  The  airfields  are  checked  in  the  order  of 
preference  specified  in  the  links  for  each  E/D  site.  The  program  will 
select  the  first  suitable  airfield  to  use  as  the  receiving  airbase.  If 
no  suitable  airbase  can  be  chosen,  that  job  is  blocked  from  further 
progress  because  it  cannot  be  delivered.  In  a  similar  manner,  prior  to 
an  aircraft  being  relocated  to  or  otherwise  being  loaded  at  an 
originating  base,  a  calculation  is  done  to  determine  the  useful  payload 
that  can  be  carried  by  the  aircraft  taking  off  from  that  base.  If  no 
useful  payload  can  be  carried,  that  cargo  is  blocked  because  it  cannot 
be  picked  up  (9:Sec  3-2  to  3-3). 

Once  the  program  has  determined  that  the  load  can  be  delivered, 
the  aircraft  is  loaded.  Two  loading  methods  are  available:  weight-and- 
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volume  loading  or  weight-only  loading.  Either  one  of  these  methods  can 
be  selected  dxiring  the  initialization  of  the  program  (9:Sec  3-3). 

At  the  receiving  base,  the  cargo  is  unloaded  for  transshipment  to 
the  delivery  site,  and  the  aircraft  is  serviced.  Once  the  servicing  has 
been  completed,  the  aircraft  is  ready  to  be  scheduled  for  another 
airlift  job  (9:Sec  3-4). 

Attrition.  One  important  aspect  of  GA^M  is  its  ability  to 
simulate  losses  due  to  conbat.  Cargo  can  be  destroyed  during 
transshipment.  Airbases  can  be  attacked  and  runways  damaged.  Aircraft 
can  be  damaged  or  destroyed  during  flight  or  while  on  the  ground.  In 
addition,  aircraft  may  break  down  and  require  maintenance.  Within  the 
program,  cargo  that  is  destroyed  is  reordered  and  damaged  runways  are 
repaired,  although  both  of  these  take  some  time  and  may  result  in  a  job 
not  being  conpleted  on  time.  However,  aircraft  that  are  destroyed 
during  the  simulation  are  not  replaced. 

GAMM  Scenario  Definition 

The  scenarios  used  in  GAMM  are  based  on  the  following  assumptions: 

1.  The  scenarios  could  occur  between  1995  and  2010. 

2.  No  nuclear,  chemical  or  biological  weapons  are  used  in  the  war. 

3.  The  airlift  jobs  were  defined  irrespective  of  airlift  resources 
available  to  accomplish  the  job,  but  are  representative  of  the 
types  of  jobs  that  airlifters  will  t3e  required  to  perform. 

4.  The  Army  AirLand  Battle  Doctrine  and  Army  21  concepts  were  used 
(24:Sec  3.1  2).  (Army  21  is  a  concept  document  that  attempts  to 
define  the  Army's  future  war  fighting  concepts  (11:4).) 
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Descriptive  scenarios  for  Europe,  Southwest  Asia  and  Central 
America  were  chosen  to  provide  a  "spectrum  of  logistics  infrastructure" 
and  a  "spectrum  of  operational  conditions"  (23:10).  Each  scenario  was 
initially  developed  as  a  qualitative  description  of  the  pre-hostility 
situation  and  the  notional  conflict  that  takes  place  (22:Sec  2-1  to  2- 
3).  This  qualitative  description  provided  the  background  from  which  the 
scenario  environment  and  tactical  airlift  requiranents  were  established. 
Once  these  had  been  established,  a  quantitative  description  of  the 
scenario  was  developed,  including  specific  airlift  jobs  (24:Sec  3.2  5; 
22:Sec  4-1  to  4-42) . 

Each  scenario  represents  a  conflict  that  lasts  30  days,  and  the 
airlift  jobs  have  been  defined  irrespective  of  the  threat  environment, 
mode  of  delivery,  or  resources  available  (24: Sec  3.2  1). 

Selection  of  Scenario 

Of  the  three  scenarios  available,  the  Central  American  scenario 
was  selected.  One  reason  for  selecting  this  scenario  was  that  the 
deficiency  analysis  had  been  able  to  identify  the  landing  gear 
performance  of  the  C-130  as  being  a  significant  deficiency  in  this 
scenario.  By  using  Central  America,  the  findings  from  this  experimental 
analysis  should  support  the  results  of  the  deficiency  analysis. 

In  addition,  the  Central  American  scenario  has  many  similarities 
to  the  type  of  conflict  that  the  Australian  Defence  Forces  might  have  to 
face  within  Australia's  Region  of  Direct  Military  Interest  (RDMI). 
Specifically,  one  of  the  likely  contingencies  that  could  require  the 
involvement  of  the  Australian  Defence  Forces  in  the  future  is  an 
escalated  low  level  conflict.  "Escalated  lew  level  conflict  could 
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spring  full-blown  onto  Australia  with  little  or  no  warning,  bringing 
attacks  of  a  more  conventional  nature  ...  against  Australia"  (1:63). 

The  terrain  and  infrastructure  of  the  Central  American  theater  is 
very  similar  to  the  type  of  terrain  and  infrastructure  in  Northern 
Australia  and  the  other  countries  within  Australia's  RIME.  These 
regions  have  very  few  roads,  almost  no  railway  systems,  only  a  limited 
number  of  major  airfields,  but  many  short,  unprepared,  grass  or  dirt 
airfields.  The  climate  is  tropical,  and  the  countries  to  the  north  and 
parts  of  Northwest  Australia  are  rugged  and  mountainous. 

Clearly,  some  details  of  the  Central  American  scenario  that 
pertain  to  U.S.  military  forces  used  and  the  strategies  and  tactics 
employed  may  not  be  directly  applicable  to  an  Australian  theater. 
However,  the  results  of  the  airlifter  analysis  may  provide  some  useful 
insights  for  tactical  airlift  in  the  Australian  Defence  Force, 

Finally,  one  practical  reason  also  determined  the  selection  of 
Central  America:  execution  time  of  the  model.  The  baseline  Central 
American  scenario  is  the  smallest  scenario  of  the  three  and  in  batch 
mode  takes  five  CPU  minutes  to  run.  By  comparison,  the  next  smallest 
scenario.  Southwest  Asia,  requires  40  CPU  minutes  to  run  in  batch  mode. 
Given  that  the  analysis  would  be  carried  out  in  the  same  manner  for  all 
scenarios,  a  shorter  execution  time  will  allow  the  runs  to  be  made  more 
expeditiously. 

The  Central  American  Scenario 

The  conflict  in  the  notional  Central  American  scenario  is  based 
upon  a  growing  insurgency  threat  to  El  Salvador.  This  insurgency  spills 
over  into  Honduras  and  cannot  be  contained  by  the  local  military.  The 
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governments  of  both  countries  request  military  assistance  from  the  U.S. 
in  order  to  repel  the  insurgents  (22:Sec  2-1  to  2-4). 

The  U.S.  government  respwids  by  sending  a  Joint  Task  Force  to 
Honduras.  The  task  force  is  made  up  of  three  cooponents:  an  Army,  Air 
Force,  and  Naval  cooponent.  Ihe  Army  coop^nent'  consists  of  an  airborne 
corps,  whose  main  ccmbat  elanents  are  a  light  infantry  division  and  an 
airborne  division.  The  Air  Force  conponent  caitains  an  air  divisicm 
from  MAC,  and  a  Tactical  Air  Wing.  The  Naval  ccoqponent  is  made  ip  of  a 
Naval  Support  Group  and  a  Marine  Amphibious  Brigade  (22:Sec  2-5). 

The  first  ten  days  of  the  scenario  are  devoted  to  the  strategic 
deployment  of  the  ground  and  air  forces  into  Hmduras.  Offensive 
operations  begin  or.  10  and  last  until  day  30.  Figure  2  shews  a 
graphical  summary-  of  the  operations  carried  out  by  the  ground  forces. 


Figure  2.  offensive  eperations  In  the  central  American  Scenario 
{22:Sec  2-10) 
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■me  locations  of  the  various  cities,  airbases  and  E/D  sites  in  the 

area  of  concern  are  shown  In  Figure  3,  but  the  many  small  airfields  that 

are  available  are  not  shown.  Figure  3  also  ctmpares  the  position  of  the 

hot  at  day  10  when  offensive  operations  began,  to  the  position  of  the 
FI/DT  at  day  21. 
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Figure  3.  central  American  FLOT  irx^tions  (22iSec  3-2) 


The  Tactical  Airlift  system,  m  the  baseline  scenario,  the 
tactical  airlift  system  consisted  of  is  C-130H  and  2  c-17  aircraft.  It, 
the  duration  of  the  conflict,  these  aircraft  are  based  out  of  a  single 
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airbase  in  the  north  of  Honduras.  For  the  Central  American  theater,  16 
representative  airlift  jobs  were  identified.  The  details  of  those  jobs 
are  presented  in  Appendix  B  and  their  occurrence  is  presented  in  Figure 
4.  These  jobs  were  combined  in  Figures  5  and  6  to  shew  the  tcxuiage 
required  to  be  airlifted  by  day  and  the  cumulative  tonnage  required  to 
be  airlifted.  The  total  tonnage  required  to  be  moved  over  the  30  day 
period  is  approximately  10,000  tons  (22:Sec  5-2). 
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Figure  5.  Tonnage  Required  By  Day  (22: Sec  5-2) 


Summary 


rhis  chapter  presented  an  overview  of  the  Generalized  Air  Mobility 
Model  (GAMM) ,  the  computer  simulation  model  that  will  be  used  in  this 
research.  It  identi'ad  the  major  elements  of  the  simulation,  and 
explained  how  these  ei._ments  i..ceract  during  the  simulation. 

A  brief  background  was  provided  concerning  the  developnent  of  the 
scenarios  used  within  GAMM,  and  the  reasons  why  the  Central  American 
scenario  was  selected  were  outlined.  Finally,  a  brief  description  of 
the  Central  American  scenario  was  provided. 
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IV.  Methodology 


Introduction 

This  research  will  utilize  GAMM  as  the  basis  for  an  experiment. 

The  results  from  this  experiment  will  be  used  to  identify  specific 
airlifter  characteristics  that  produce  the  greatest  improvement  in 
tactical  airlift  capability.  In  this  chapter,  the  following  topics  will 
be  covered:  the  selection  of  an  appropriate  experimental  design,  the 
definition  of  experimental  variables,  and  the  selection  of  measrures  of 
effectiveness  for  the  experiment.  In  addition,  the  methods  used  to 
analyze  the  experimental  results  and  identify  significant  airlifter 
characteristics  will  be  discussed. 

Weatoess  of  One-Variable-at-a-Time  Strategy  (4:510-513) 

The  deficiency  analysis  of  the  C-130H,  carried  out  as  part  of  the 
ATTMA  project,  was  primarily  intended  to  "identify  specific  airlifter- 
related  problems  v^ich  prevent  the  accomplishment  of  the  required 
throughput  on  future  battlefields"  (24:Sec  3.4  1).  This  study  found 
that  no  single  deficiency  significantly  affected  the  C-130's  airlift 
capability  in  Europe  or  Southwest  Asia.  In  contrast,  one  deficiency 
that  significantly  affected  the  C-130's  capability  in  Central  America 
was  the  undercarriage's  inability  to  operate  on  the  many  unprepared 
airfields  in  the  region. 

A  previous  study,  carried  out  by  ASD/XEM  using  response  surface 
methodology  techniques,  attempted  to  screen  the  airlifter  parameters 
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used  within  GAMM  for  significant  effects.  However,  this  study  proved 
inconclusive  and  was  never  published  (25). 

While  it  was  not  intended  as  a  screening  analysis,  the  deficiency 
analysis  was  the  only  available  study  that  used  GAMM  to  identify 
significant  tactical  airlifter  characteristics.  For  the  majority  of  the 
runs,  this  was  done  by  changing  only  one  or  two  aircraft  parameters  at  a 
time.  The  limitation  of  this  method  is  highlighted  in  the  example 
below,  which  is  drawn  frc*n  Chapter  15  of  Statistics  for  Experimenters, 
by  E:-x,  Hunter  and  Hunter. 

Suppose  a  chemist  is  trying  to  determine  the  maximum  yield  of 
certain  chemical  reaction  that  is  dependent  upon  only  two  variables,  the 
temperature  of  the  reaction  and  the  reaction  time.  The  relationship  of 
these  two  variables  to  the  yield  of  the  reaction  is  not  known  so  the 
following  experiment  is  set  up. 

For  the  first  set  of  runs,  the  chemist  fixes  the  temperature  of 
the  reaction  at  225°C  and  varies  the  reaction  time  of  the  experiment. 

The  results  may  look  like  the  first  graph  of  Figure  7.  Having  found  a 
maximum  yield  at  a  reaction  time  of  130  minutes,  the  next  set  of  runs 
locks  the  reaction  time  at  130  minutes  and  the  reaction  temperature  is 
varied.  The  results  may  look  like  the  second  graph  of  Figure  7,  shewing 
a  maximum  yield  at  a  temperature  of  225°C.  The  chemist  may  then 
conclude  that  the  maximum  yield  for  this  reaction  occurs  with  a  reaction 
temperature  of  225‘’C  and  a  reaction  time  of  130  minutes. 

The  chemist  has  assumed  that  the  effect  of  each  variable  on  the 
yield  of  the  reaction  is  independent  of  the  other  variable.  However, 
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because  the  relationship  of  these  variables  on  the  yield  is  not  known, 
this  assvraption  may  be  incorrect. 

The  third  graph  of  Figure  7  shews  a  contour  diagram  that  could 
represent  the  "joint  functional  dependence  of  mean  yield  on  time  and 
temperature"  for  this  reaction  (4:512).  It  also  shows  the  series  of 
experiments  that  the  chemist  actually  carried  out  using  the  one-at-a- 
time  method.  The  graph  clearly  shows  that  the  chemist  was  only  able  to 
determine  a  marginal  optima  for  this  reaction  and  that  the  values  of  the 
two  variables  at  the  true  maximum  yield  for  this  reaction  were 
significantly  different  frean  the  values  the  chemist  determined. 

The  limitation  of  the  one-variable-at-a-time  method  is  that  it 
assumes  the  variables  are  independent,  if  the  variables  are  not 
independent,  this  approach  will  lead  to  optimal  settings  for  each 
variable,  conditioned  on  the  fixed  levels  of  the  other  variables.  This 
one-variable-at-a-time  solution  may  be  significantly  different  frem  the 
optimum  solution.  The  deficiency  analysis  of  the  C-130H,  by  varying 
only  one  or  two  aircraft  parameters  at  a  time,  assumed  that  the  effect 
of  these  parameters  on  tactical  airlift  capability  was  independent. 
However,  because  the  relationship  between  aircraft  parameters  and 
tactical  airlift  capability  is  not  known,  this  assumption  may  not  be 
correct . 

Selection  of  an  Experimental  Design 

In  the  situation  where  no  theory  is  available  to  represent  the 
relationship  of  variables  to  an  output,  an  experimental  design  based  on 
an  empirical  approach  should  be  followed.  One  recommended  empirical 
approach  is  the  factorial  design.  Factorial  designs  allow  each  variable 
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to  be  assessed  using  a  variety  of  different  levels  of  all  the  other 
variables  in  the  experiment  (4:298-303).  In  addition,  factorial 
designs  "can  also  provide  estimates  of  the  'effects'  of  the  changes, 
which  are  infected  as  little  as  possible  by  experimental  error"  (4:302). 

Factorial  designs  can  be  either  full  factorial,  where  all 
variables  are  canpared  at  all  levels,  or  fractional  factorial,  vrtiere  a 
selected  fraction  of  all  the  possible  canbinations  is  used.  The 
individual  experimenter  chooses  the  number  of  levels  at  which  each 
variable  is  tested  and  the  type  of  factorial  design  that  is  to  be  used. 
For  this  analysis,  a  two  level  full  factorial  design  was  selected.  That 
is,  for  each  aircraft  characteristic  being  assessed,  two  values  were 
chosen.  The  two  values  represent  the  high  and  lew  levels  of  the  two 
level  factorial  design.  At  each  value,  each  characteristic  is  compared 
with  every  possible  combinatior  of  the  other  characteristics. .The 
strengths  of  this  design  are: 

1.  Fewer  runs  are  required  per  variable  studied  because  of  greater 
precision.  A  one-variable-at-a-time  method  with  k  variables  would 
generally  require  k  times  as  many  runs  to  achieve  the  same  level 
of  precision  (4:312-313). 

2.  Major  trends  can  be  identified  for  further  research. 

3.  Additional  experiments  can  be  easily  added  to  the  experiment  to 
allow  more  thorough  analysis. 

4.  The  interpretation  of  the  results  "can  proceed  largely  by  cannon 
sense  and  elementary  arithmetic"  (4:306-307). 

Factorial  designs  make  the  assumption  that  the  output  that  is 
being  modeled  represents  a  smooth  response  surface  without  any 
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discontinuities,  at  least  within  the  range  of  the  characteristics 
selected. 

With  any  reasonable  number  of  experimental  runs,  mapping  a  surface 
resembling  a  nest  of  stalagmites  or  the  back  of  a  porcupine  would 
be  impossible.  Furthermore,  for  such  a  surface,  sequential 
experimentation  would  be  useless,  since  characteristics  of  the 
surface  at  one  point  would  not  be  related  to  characteristics 
elsevAiere.  (4:300) 

Given  that  most  relationships  do  have  some  degree  of  continuity 
and  smoothness,  the  experimenter  must  then  select  appropriate  values  for 
high  and  lew  levels  of  the  variables  being  assessed.  One  shortcoming  of 
the  factorial  design  is  that  these  values  are  selected  without  the 
experimenter  knowing  the  shape  of  the  response  surface.  The  chosen 
values  of  the  high  and  low  levels  of  each  variable  must  be  wide  enough 
apart  to  identify  major  trends  in  the  response  surface,  such  as  the 
slope.  However,  these  values  cannot  be  so  wide  apart  that  the  major 
features  of  the  response  surface,  such  as  maxima,  minima,  or  ridges, 
cannot  be  identified. 

Another  limitation  of  the  two  level  factorial  design  is  that  it 
can  only  assess  first  order  terms  and  their  associated  interaction 
terms.  The  two  level  factorial  design  essentially  maps  a  plane, 
representing  the  first  order  and  interaction  terms,  onto  the  response 
surface  being  assessed.  The  plane  can  identify  major  trends  such  as  the 
slope  of  the  surface,  but  it  cannot  provide  information  about  the 
curvature  of  the  surface,  which  is  due  to  second  and  higher  order  terms. 
Additional  experimental  data  pxoints  would  be  required  to  assess  the 
curvature  of  the  response  surface  within  the  region  being  examined  by 
the  two  level  factorial  design  (4:516). 
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Selection  of  Variables 


For  a  two  level  full  factorial  design  assessing  ic  variables,  the 
number  of  experiments  required  are  2*^.  Testing  all  the  aircraft 
parameters  in  GAMM  using  this  design  would  require  2^^  experiments. 

Since  this  was  not  practical,  the  number  of  parameters  had  to  be 
rationalized.  Two  different  methods  were  used  to  do  this. 

First,  the  scope  of  this  analysis  was  reduced  to  only  consider 
parameters  related  to  airframes.  All  parameters  related  to  reliability 
or  vulnerability  were  set  so  that  they  would  not  affect  the  performance 
of  the  airlifter  (see  Appendix  A).  Ttie  Vulnerability  Exponent  was  set 
to  1.00.  This  made  the  aircraft  impervious  to  ground  attack.  All 
parameters  related  to  Mean  Time  Between  Failure  were  set  to  very  large 
values  so  that  reliability  factors  did  not  prevent  aircraft  from 
undertaking  or  completing  a  mission,  in  addition,  all  parameters  in  the 
scenario  file  that  dealt  with  attrition  were  reset  so  that  there  was  no 
attrition  in  the  model.  This  included  parameters  for  airbases,  other 
airfields  and  drop  zones,  and  also  the  transhipment  links  between  E/D 
sites  and  the  linked  airfields. 

By  doing  this,  the  analysis  was  assessing  a  system  that  was  at  its 
optimum  performance.  As  other  parameters  were  changed,  the  optimum 
performance  of  the  tactical  airlift  system  changed.  The  analysis  could 
then  be  used  to  determine  what  canbination  of  parameters  resulted  in  the 
ultimate  performance  of  the  system. 

A  number  of  other  parameters  remained  constant  throughout  and  were 
not  assessed.  This  included  all  parameters  that  concerned  the 
stochastic  nature  of  the  model.  Other  parameters  that  remained  the  same 
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included  Taxi,  Takeoff  and  Landing  time;  Reserve  Fuel;  Payload  Margin 
Next  Flight;  Loading  and  Unloading  Factor  for  Rolling  Stock;  Mean  Time 
to  Repair;  VTOL  Max  Useful  Load;  and  Airfield  Tanperatures  at  Sea  Level 
and  at  5000  ft. 

Having  removed  all  these  parameters  fran  consideration,  43 
parameters  still  remained.  All  the  ronaining  parameters  were  considered 
to  be  significant  to  the  experiment. 

To  reduce  the  number  of  variables  in  the  experiment  to  more 
manageable  numbers,  the  43  parameters  were  then  grouped  into  five 
f’onctional  sets.  The  five  functional  sets  were:  Field  Performance  (F), 
Cargo  Cabin  (C) ,  Inflight  Performance  (i).  Ground  Flotation/Wheel 
Loading  (G),  and  Servicing  and  Aircraft  Loading/Unloading  (S).  The 
parameters  contained  in  these  sets  are  listed  in  Table  1. 

The  groupings  were  determined  by  combining  parameters  that  were 
tlosely  related  in  aircraft  function  or  purpose.  For  example,  cargo 
cabin  size  is  related  to  the  parameters  for  cargo  bay  width,  height  and 
length,  and  the  size  of  the  cabin  directly  affects  the  size  of  the 
aircraft  (Aircraft  Spot  Factor).  Generally,  as  aircraft  increase  in 
size,  all  cabin  dimensions  v/ill  increase  and  the  aircraft's  Maximum 
Cabin  Payload  will  also  tend  to  increase.  Similarly,  the  Time  to 
Unload,  Service,  and  Load  the  aircraft  directly  affects  aircraft 
turnaround  times. 

Hov/ever,  grouping  the  parameters  confounds  any  analysis  concerning 
individual  parameters,  because  the  effect  of  any  single  parameter  would 
be  combined  with  the  effects  of  the  other  parameters  within  any  one  set. 
This  limitation  was  accepted  because  the  primary  purpose  of  this 
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Table  1:  GAMM  Airlifter  Functional  Parameter  Sets 


Field  Performance  (F); 
for  sea  level  and  at  5000  ft, 
for  hot  and  cold  conditions 


CrOL  TO  AT  MAX  USEHJL  LOAD  (FT) 
CTOL  ID  AT  MAX  USEFUL  LOAD  (FT) 
CTOL  TO  AT  MID  USEFUL  LOAD  (FT) 
CTOL  ID  AT  MID  USEFUL  LOAD  (FT) 
CTOL  TO  AT  ZERO  USEFUL  LOAD  (FT) 
CTOL  ID  AT  ZERO  USEFUL  LOAD  (FT) 


Cargo  Cabin  (C) 

CARC30  BAY  WIDTH  (INCH) 

CARGO  BAY  HEIGHT  (INCH) 

CARGO  BAY  LENGIH  (INCH) 

CARGO  BAY  DOOR  WIDTH  (INCH) 
CARGO  BAY  DOOR  HEIGHT  (INCH) 
CTOL  MAX  USEFUL  LOAD  (LBS) 

CTOL  MID  USEFUL  LOAD  (LBS) 
MAXIMUM  CABIN  PAYLOAD  (LBS) 
AIRCRAFT  SPOT  FACTOR  (NO) 

CARGO  THRESHOLD  FOR  RELOCATIOTI  (LBS) 


Inflight  Performance  (I) 


MAXIMUM  FERRY  FUEL  (LBS) 
CRUISE  FUEL  (LBS/HR) 
CRUISE  SPEED  (KNOTS) 
TAKEOFF/LANDING  FUEL  BIAS  (LBS) 


Ground  Flotation/Wheel  Loading  (G) 

LCN  -  MAX  USEFUL  LOAD  (NO) 

LCN  -  AT  ZERO  USEFUL  LOAD  (NO) 


Servicing  and  Aircraft  Loading/Unloading  (S) 

MEAN  TIME  TO  SERVICE  (HRS) 

MEAN  TIME  TO  LOAD  (HRS) 

MEAN  TIME  TO  UNLOAD  (HRS) 
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experiment  was  to  screen  the  chosen  variables  to  determine  v^ich  were 
significant.  If  significant  variables  were  found,  the  next  step  in  the 
analysis  might  be  to  carry  out  a  more  detailed  analysis  of  the 
individual  parameters  that  comprised  the  significant  sets.  The 
parameters  in  the  sets  that  were  not  significant  could  be  disregarded 
with  some  level  of  confidence. 

Defining  Measures  of  Effectiveness 

Before  defining  the  value  of  the  variables  that  will  be  used  in 
the  experiment,  it  is  necessary  to  define  the  measures  that  will  be  used 
to  determine  the  effectiveness  of  the  tactical  airlift  system  in  GAMM. 
The  deficiency  analysis  used  two  primary  measures  of  effectiveness:  Tons 
Delivered  On  Time,  and  Total  Tons  Delivered.  For  this  experiment, 
however,  because  only  one  scenario  is  being  used,  the  actual  amount  of 
cargo  delivered  is  not  as  important  as  knowing  what  proportion  of  the 
total  available  cargo  arrived  on  time  and  what  proportion  was  actually 
delivered.  Thus  the  primary  measures  of  effectiveness  will  be  Ratio  on 
Time  and  Ratio  Delivered. 

In  addition,  four  secondary  measures  of  effectiveness  were 
selected.  These  secondary  measures  were  intended  to  assess  how  hard  the 
tactical  airlift  system  was  being  worked  in  order  to  achieve  a  given 
level  of  effectiveness.  The  four  secondary  measures  were:  Total  Flight 
Hours,  Total  Sorties,  Productive  Flight  Hours,  and  Productive  Sorties. 
These  four  measures  would  also  provide  an  indication  of  the  efficiency 
of  the  tactical  airlift  system. 
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Specification  of  Variables 


For  the  two  level  factorial  experiment,  high  and  low  levels  of  the 
variables  were  required.  To  achieve  this,  the  individual  parameters 
within  the  variables  were  set  to  high  and  lew  levels.  In  selecting  the 
values  for  these  parameters,  the  following  points  were  considered: 

1.  For  the  factorial  design,  the  values  had  to  be  sufficiently  far 
apar^  to  ensure  identification  of  a  trend  in  the  response  surface. 

2.  The  selected  values  could  not  be  so  far  apart  that  they  fail  to 
identify  significant  features  of  the  response  surface. 

3.  Values  should  be  selected  around  the  C-130  baseline  so  that  any 
significant  findings  can  be  directly  related  to  the  C-130 
deficiency  analysis  previously  carried  out,  and  may  also  be  ' 
directly  applicable  to  the  aircraft  that  becomes  the  C-130 
replacement. 

Suitable  values  were  determined  by  the  following  procedure.  The 
baseline  C-130H  parameters  were  multiplied  by  2/3  to  produce  an  aircraft 
that  was  two  thirds  the  size  of  a  C-130.  The  values  for  the  cabin 
dimensions  were  then  modified  slightly  to  allow  the  cabin  to  hold  three 
ammunition  (AMTIO)  pallets  (a  single  AMMO  pallet  has  a  base  of  104  x  84 
inches  and  in  GAMM  is  96  inches  high).  Similarly,  the  baseline  C-130H 
parameters  were  multiplied  by  4/3  to  produce  an  aircraft  that  was  four 
thirds  the  size  of  a  C-130.  Again,  the  cabin  dimensions  were  modified 
slightly  to  enable  the  cabin  to  carry  7  AMMO  pallets.  For  the  majority 
of  the  parameters,  the  smaller  values  were  half  the  larger  values. 

However,  to  define  the  high  and  low  levels  of  each  variable,  the 
primary  measure  of  Ratio  On  Time  needed  to  be  considered.  Variables 
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were  defined  as  high  level  if  they  were  expected  to  increase  the  Ratio 
On  Time  value.  Otherwise,  they  were  defined  as  low  level.  Therefore, 
high  and  low  levels  do  not  always  correspond  to  high  and  low  values  of 
the  parameters.  For  Field  Performance,  the  highest  value  of  Ratio  On 
Time  is  expected  when  aircraft  can  make  use  of  shorter  airfields.  The 
high  level  of  this  variable  corresponds  to  the  smaller  values  of  takeoff 
and  landing  distances.  For  Cargo  Cabin  and  Inflight  Performance,  the 
high  levels  correspond  to  the  larger  parameter  values.  For  the  Ground 
Flotation/Wheel  Loading  and  Servicing/Loading  variables,  increased 
throughput  is  expected  when  the  values  of  the  parameters  are  smaller. 

The  high  and  low  levels  of  the  variables  are  defined  in  Table  2. 

One  other  important  operational  aspect  that  might  influence  the 
efficacy  of  the  tactical  airlift  system  was  the  number  of  available 
aircraft.  In  the  baseline  analysis  and  the  deficiency  analysis 
previously  mentioned,  two  aircraft  types  were  used  in  each  scenario:  the 
C-17,  and  the  C-130  or  C-130  variants.  However,  for  this  analysis,  the 
C-17  was  not  used  because  having  more  than  one  aircraft  type  in  the 
scenario  would  make  the  interpretation  of  the  results  more  difficult. 

For  the  single  aircraft  type  used  in  the  scenario,  the  number  of 
aircraft  was  varied  fran  a  low  level  to  a  high  level.  The  high  level 
was  set  at  32  aircraft,  and  the  low  level  was  16  aircraft. 

These  six  variables.  Aircraft  Numbers  (A),  Field  Performance  (F), 
Cargo  Cabin  (C),  Inflight  Performance  (I),  Ground  Flotation/Wheel 
Loading  (G),  and  Servicing  and  Aircraft  Loading/Unloading  (S),  form  the 
basis  of  the  experiment.  Table  3  shows  the  design  matrix  of  this  2^  two 
level  full  factorial  design.  For  convention,  the  high  level  of  the 
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Tab^ e  2.  Definition  of  Variables  -  Two  Level  Factorial  T: 


Field  Performance  (F) 

“  S£1A  XiEIVEilj  ” 

-  5000  FEET  - 

HOT 

COLD 

HOT 

COLD 

Hiqh  Level  (+) 

103  F 

59  F 

84  F 

41  F 

CrOL  TO  AT  MAX  USEFUL  LOAD  (FT) 

2387 

1787 

/i3 

2293 

CTOL  LD  AT  MAX  USEFUL  LOAD  (FT) 

1520 

1433 

1713 

1620 

CrOL  TO  AT  MID  USEFUL  LOAD  (FT) 

1320 

1080 

1560 

1340 

CTOL  LD  AT  MID  USEFUL  LOAD  (FT) 

1260 

1200 

1400 

1333 

CTOL  TO  AT  ZERO  USEFUL  LOAD  (ET) 

720 

633 

827 

740 

CTOL  LD  AT  ZERO  USEFUL  LOAD  (FT) 

1000 

947 

1093 

1020 

Low  Level  (-) 

CTOL  TO  AT  MAX  USEFUL  LOAD  (FT) 

4773 

3573 

5427 

4587 

CTOL  LD  AT  MAX  USEFUL  LOAD  (FT) 

3040 

2867 

3427 

3240 

CTOL  TO  AT  MID  USEFUL  LOAD  (FT) 

2640 

2160 

3120 

2680 

CTOL  LD  AT  MID  USEFUL  LOAD  (FT) 

2520 

2400 

2800 

2667 

CTOL  TO  AT  ZERO  USEFUL  LOAD  (FT) 

1440 

1267 

1653 

1480 

CTOL  LD  AT  ZERO  USEFUL  LOAD  (FT) 

2000 

1893 

2187 

2040 

Carqo  Cabin  (C) 

Hiqh  Level 

_1±1 

Low  Level  (-) 

CARGO  BAY  WIDTH  (INCH) 

131 

95 

CARGO  BAY  HEIOTT  (INCH) 

126 

97 

CARGO  BAY  LENGTH  (INCH) 

656 

350 

CARGO  BAY  DOOR  WIDTH  (INCH) 

140 

100 

CARGO  BAY  DOOR  HEIOfT  (INCH) 

130 

100 

CTOL  MAX  USEFUL  LOAD  (LBS) 

96000 

48000 

CTOL  MID  USEFUL  LOAD  (LBS) 

49332 

24667 

MAXIMUM  CABIN  PAYLOAD  (LBS) 

67733 

33867 

AIRCRAFT  SPOT  FACTOR  (NO) 

1.4 

0.7 

CARGO  THRESHOLD  FOR  RELOCATION 

20000 

10000 

Infliqht  Performance  (I) 

Hiqh  Level 

i±i 

Lew 

Level  (-) 

MAXIMUM  FERRY  FUEL  (LBS) 

77960 

39980 

CRUISE  FUEL  (LBS/HR) 

7067 

3533 

CRUISE  SPEED  (KNOTS) 

360 

180 

TAKEOFF/LANDING  ETJEL  BIAS 

2000 

1000 

Ground  Flotation/Wheel  Loading  (G) 


Hiqh  Level  (+' 

Lew  Level  (-) 

LCN  -  MAX  USEFUL  LOAD  (NO) 

26 

52 

LCN  -  AT  ZERO  USEFUL  LOAD  (NO) 

12 

24 

Servicinq  and  Aircraft  Loadinq/Unloadinq  (S) 

Hiqh  Level  (+) 

Lew  Level  (-) 

MEAN  TIME  TO  SERVICE  (HRS) 

0.35 

0.7 

MEAN  TIME  TO  LOAD  (HRS) 

0.6 

1.4 

MEAN  TIME  TO  UNLOAD  (HRS) 

0.2 

0.4 

Aircraft  Numbers  (A) 

32 

16 
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Table  3.  2^  lyro  Level  Full  Factorial  Design  Matrix 


Test  Design  Matrix  Test  Design  Matrix 

Condition  Variables  Identi-  Condition  Variables  Identi- 


Number 

f ication 

Number 

f ication 

AFC 

I 

G 

S 

A  F 

C 

I 

G 

S 

1 

- 

- 

- 

- 

- 

- 

33 

- 

- 

- 

- 

- 

+ 

S 

2 

+ 

- 

- 

- 

- 

- 

A 

34 

+ 

- 

- 

- 

- 

+ 

AS 

3 

- 

+ 

- 

- 

- 

- 

F 

35 

- 

+ 

- 

- 

- 

+ 

FS 

4 

+ 

+ 

- 

- 

- 

- 

AF 

36 

+ 

+ 

- 

- 

- 

+ 

AFS 

5 

- 

- 

+ 

- 

- 

- 

C 

37 

- 

- 

+ 

- 

- 

+ 

CS 

6 

+ 

- 

+ 

- 

- 

- 

AC 

38 

+ 

- 

+ 

- 

- 

+ 

ACS 

7 

- 

+ 

+ 

- 

- 

- 

PC 

39 

- 

+ 

+ 

- 

- 

+ 

PCS 

8 

+ 

+ 

+ 

- 

- 

- 

AFC 

40 

+ 

+ 

+ 

- 

- 

+ 

APCS 

9 

- 

- 

- 

+ 

- 

- 

I 

41 

- 

- 

- 

+ 

- 

+ 

IS 

10 

+ 

- 

- 

+ 

- 

- 

AI 

42 

+ 

- 

- 

+ 

- 

+ 

AIS 

11 

- 

+ 

- 

+ 

- 

- 

FI 

43 

- 

+ 

- 

+ 

- 

+ 

FIS 

12 

+ 

+ 

- 

+ 

- 

- 

At  I 

44 

+ 

+ 

- 

+ 

- 

+ 

APIS 

13 

- 

- 

+ 

+ 

- 

- 

JI 

45 

- 

- 

+ 

+ 

- 

+ 

CIS 

14 

+ 

- 

+ 

+ 

- 

- 

ACI 

46 

+ 

- 

+ 

+ 

- 

+ 

ACIS 

15 

- 

+ 

+ 

+ 

- 

- 

■  FCI 

47 

- 

+ 

+ 

+ 

- 

+ 

PCIS 

16 

+ 

+ 

+ 

+ 

- 

- 

AECI 

48 

+ 

+ 

+ 

+ 

- 

+ 

APCIS 

17 

- 

- 

- 

- 

+ 

- 

G 

49 

- 

- 

- 

- 

+ 

+ 

GS 

18 

+ 

- 

- 

- 

+ 

- 

AG 

50 

+ 

- 

- 

- 

+ 

+ 

AGS 

19 

- 

+ 

- 

- 

+ 

- 

PG 

51 

- 

+ 

- 

- 

+ 

+ 

PGS 

20 

+ 

- 

- 

+ 

- 

APG 

52 

+ 

+ 

- 

- 

+ 

+ 

APGS 

21 

- 

- 

+ 

- 

+ 

- 

CG 

53 

- 

- 

+ 

- 

+ 

+ 

CGS 

22 

+ 

- 

+ 

- 

+ 

- 

ACG 

54 

+ 

- 

+ 

- 

+ 

+ 

ACGS 

23 

- 

+ 

+ 

- 

+ 

- 

PCG 

55 

- 

+ 

+ 

- 

+ 

+ 

PCGS 

24 

+ 

+ 

+ 

- 

+ 

- 

AFCG 

56 

+ 

+ 

+ 

- 

+ 

+ 

APCGS 

25 

- 

- 

- 

+ 

+ 

- 

IG 

57 

- 

- 

- 

+ 

+ 

+ 

IGS 

26 

+ 

- 

- 

+ 

+ 

- 

AIG 

58 

+ 

- 

- 

+ 

+ 

+ 

AIGS 

27 

- 

+ 

- 

+ 

+ 

- 

FIG 

59 

- 

+ 

- 

+ 

+ 

+ 

FIGS 

28 

+ 

+ 

- 

+ 

+ 

- 

AFIG 

60 

+ 

+ 

- 

+ 

+ 

+ 

AFIGS 

29 

- 

- 

+ 

+ 

+ 

- 

CIG 

61 

- 

- 

+ 

+ 

+ 

+ 

CIGS 

30 

+ 

- 

+ 

+ 

- 

ACIG 

62 

+ 

- 

+ 

+ 

+ 

ACIGS 

31 

- 

+ 

+ 

+ 

+ 

- 

PCIG 

63 

- 

+ 

+ 

+ 

+ 

+ 

PCIGS 

32 

+ 

+ 

+ 

+ 

+ 

- 

APCIG 

64 

+ 

+ 

+ 

+ 

+ 

i- 

APCIGS 
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variables  is  coded  by  a  plus  sign  and  the  low  level  by  a  minus  sign 
(4:308) . 

standard  GAMM  Initializing  Parameters 

When  initializing  a  scenario  using  the  user  is  presented 

with  a  series  of  questions  that  he  must  answer  to  run  the  program.  Sane 
of  the  questions  relate  to  the  airlift  job  and  scenario  files  that  are 
about  to  be  used  in  GAMM.  A  large  proportion  simply  require  the  user  to 
respond  Yes  or  No  to  the  questions. 

In  addition  to  these,  a  number  of  the  questions  ask  for  values  to 
be  specified  for  parameters  that  are  used  within  the  whole  model.  Some 
of  the  parameters  that  can  be  specified  here  ir.,lude  the  Priority 
Scheduling  Factor,  the  user  determined  method  for  aircraft  loading,  and 
the  length  of  the  crew  duty  day  for  aircrew.  Variation  in  these 
parameters  can  cause  a  dramatic  change  in  the  results  of  the  simulation 
without  changing  any  other  aspect  of  the  scenario. 

An  example  of  the  questions  presented  in  the  initialization  of 
GAMM  is  contained  in  Appendix  C.  The  questions  and  the  responses  in 
Appendix  C  are  based  on  the  use  of  an  existing  scenario  and  jobs  file, 
multiple  repetitions  of  the  scenario,  and  the  model  being  run  in  batch 
mode  rather  than  in  interactive  mode.  The  order  and  number  of  questions 
will  vary  if  the  user  responds  differently  to  the  questions,  but  the 
questions  that  define  the  parameters  initializing  GAMM  will  always  be 
asked.  A  more  extensive  listing  of  these  initial  questions  can  be  found 
in  the  GAMM  User's  Manual  (10:Sec  3-1  to  3-249). 

To  standardize  the  experiments  in  GAMM,  the  initializing 
parameters  were  set  at  the  same  values  used  in  the  baseline  analysis  for 
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all  the  simulation  runs.  These  values  were  also  used  for  the  majority 
of  the  runs  carried  out  in  the  deficiency  analysis.  By  using  the  same 
initializing  parameter  values,  the  results  of  this  analysis  could  be 
directly  conpared  to  the  results  of  the  previous  studies.  The  parameter 
values  can  be  found  in  ^s^jpendix  C. 

Stochastic  Modeling 

A  discrete  event  simulation  is  in  fact  a  statistical  experiment. 
The  output  variables  are  estimates  that  contain  randan  error,  and 
therefore  a  proper  statistical  analysis  is  required.  Such  a 
philosophy  is  in  contrast  to  the  analyst  v^o  makes  a  single  nm 
and  draws  an  inference  frcan  that  single  data  point.  (3:15) 

The  stochastic  nature  of  a  simulation  is  the  result  of  two 

factors-  a  randan  number  generator,  and  parameters  within  the  model  that 

are  described  by  a  statistical  distribution.  Within  GAMM,  a  number  of 

parameters  are  defined  with  a  mean  value  and  a  standard  deviation. 

These  parameters  are  shown  in  /^jpendix  A.  Ttie  randan  number  generator 

within  GAT^M  uses  these  values  to  generate  a  randan  value  within  the 

possible  distribution  of  values,  for  any  single  event.  For  modeling 

purposes,  this  technique  is  used  to  model  the  range  of  variation  that 

occurs  in  the  real  world. 

A  user  defined  random  number  seed  determines  the  sequence  of 
random  numbers  produced  by  the  randan  number  generator.  Therefore,  runs 
of  a  simulation  using  the  same  randcan  number  seed  will  always  result  in 
the  same  output.  To  achieve  the  real  world  variation  in  simulation 
output,  genuine  replications  are  required.  That  is,  the  randan  number 
streams  used  for  multiple  replications  must  be  different  for  each 
repl i cat  ion. 
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As  mentioned  earlier,  a  number  of  parameters  were  held  constant 
for  all  experimental  runs.  This  included  all  standard  deviation 
paraitteters  (see  ;^3pendix  A).  However,  for  this  experiment,  the 
parameters  in  the  input  files  that  represent  standard  deviations  were 
set  to  very  small  numbers.  Since  the  algorithms  for  calculating 
parameter  values  within  GAMM  would  not  accept  standard  deviations  of 
zero,  values  of  0.001  or  0.01  were  used.  Such  an  approach  rendered  the 
model  more  deterministic.  An  additional  advantage  of  restricting  the 
variation  in  the  simulation  was  a  reduction  in  the  minimum  number  of 
replications  needed  for  statistical  analysis. 

To  ensure  that  each  run  was  randomized  as  much  as  possible,  a 
different  random  number  seed  was  used  for  each  batch  of  runs.  Because 
different  random  numbers  are  being  used  for  calculations  within  the 
model,  the  results  of  different  runs  should  be  completely  independent 
f ran  one  another . 

Determining  the  Required  Number  of  Replications  (3:421-429) 

It  is  not  possible  to  estimate  the  accuracy  of  the  output  of  a 
simulation  fron  a  single  run.  Multiple  replications  under  identical 
conditions  are  required  to  establish  a  confidence  interval  about  a 
statistic.  However,  carrying  out  a  large  number  of  replications  is  time 
consuming.  A  method  is  needed  to  determine  the  minimum  number  of 
replications  required  to  achieve  a  specific  level  of  accuracy  for  the 
output.  One  method  is  outlined  below. 

A  number  of  simulation  runs  are  carried  out,  each  repeated  a  total 
of  R  times,  with  each  run  using  a  different  randan  number  stream 
(3:421).  The  accuracy  of  the  output  measure  can  be  defined  by  the  half- 
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length  of  a  confidence  interval  for  a  mean  based  on  the  t 

distribution,  as  follows: 

h-l-  =  (^)  (1) 

5  (t)  =  -^ 

S  =  the  sample  standard  deviation 
R  =  the  number  of  replications 

Fran  an  initial  sample  of  independent  replications,  an 
estimate,  sj ,  of  the  population  variance,  can  be  obtained.  For  a 
given  level  of  accuracy,  e,  to  meet  the  half-length  criteria,  a  sample 
size  R  must  be  chosen  such  that  R  ^  and 

s  e  (2) 

Solving  the  inequality  for  R  gives: 

R  ^  f  (3) 

V  e  ) 

From  a  series  of  independent  single  simulation  runs,  each  using 
different  random  number  seeds,  the  values  of  the  six  output  measures 
that  are  going  to  be  used  in  the  analysis  are  recorded.  A  sample 
standard  deviation  can  be  calculated  by  selecting  number  of  values 
for  each  of  the  output  measures.  By  choosing  appropriate  values  for  the 


vAiere 


and 
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probability  a  and  the  accuracy  z,  the  right  hand  side  of  Equation  3  can 
be  determined.  If  the  value  calculated  for  the  right  hand  side  of 
Equation  3  is  greater  than  then  the  sample  needs  to  be  increased. 
Additional  values  are  added  to  the  sample  and  the  calculations  are 
repeated.  When  the  right  hand  side  of  the  equation  is  calculated  to  be 
less  than  R^,  the  value  of  represents  the  minimum  number  of 
replications  required  to  achieve  the  specified  accuracy  with  the 
specified  probability. 

Because  six  output  measures  are  being  considered  in  this  analysis, 
the  value  selected  as  the  minimum  number  of  replications  must  result  in 
all  six  measures  achieving  the  specified  accuracy  and  probability. 

Modification  of  Scenario  Files 

One  of  the  assumptions  of  the  factorial  design  is  that  the 
functions  being  modeled  are  smooth  and  continuous.  If  the  functions  are 
not  smooth  and  continuous,  a  factorial  experiment  would  not  be  able  to 
determine  the  true  characteristics  of  the  surface  being  mapped. 

This  assumption  is  significant  in  the  Central  American  scenario 
because  of  the  importance  of  one  set  of  parameters  in  the  irKxJel :  the 
aircraft's  Load  Classification  Numbers  (LCN).  LCN  values  are  used  to 
determine  the  maximum  cargo  that  can  be  carried  by  an  aircraft  to  a 
destination  airfield. 

For  each  aircraft  type,  two  parameters  are  required:  LCN  at  empty 
weight  and  LCN  at  maximum  payload.  Also,  each  airfield  has  an  LCN  value 
which  determines  the  largest  and  heaviest  aircraft  that  can  safely 
operate  into  that  field.  If  the  destination  airfield's  LCN  value  is 
small,  less  cargo  can  be  flown  in  per  aircraft.  However,  the  more 
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critical  situation  occurs  when  the  LCN  value  of  the  destination  airfield 
is  so  small  that  the  aircraft  cannot  operate  into  that  airfield  at  any 
weight. 

Of  the  33  airfields  in  the  Central  American  scenario,  13  airfields 
cannot  be  used  by  any  airlifter  in  the  experiment  because  their  LCN 
values  are  less  than  12.  This  value  is  the  LCN  at  aircraft  empty  weight 
for  the  high  level  of  the  Ground  Flotation  variable,  that  is,  the 
variable  that  allows  the  aircraft  to  land  on  the  softest  airfields. 
Another  ll  airfields  have  an  LCN  value  that  is  less  than  24,  which  is 
the  LCN  value  at  aircraft  empty  weight  for  the  lew  level  of  the  Ground 
Flotation  variable. 

Only  9  airfields  remain.  Given  that  one  of  the  airfields  is  used 
as  the  hcxne  base  of  the  aircraft,  only  8  airfields  are  available  as  in¬ 
theater  destinations  that  allow  operations  at  both  levels  of  the  Ground 
Flotation  variable.  The  impact  of  this  on  the  likely  performance  of  the 
airlift  system  can  be  determined  by  examining  both  the  scenario  file  and 
the  jobs  file.  Airlift  jobs  that  originate  or  are  destined  for  E/D 
sites  that  are  not  linked  to  one  of  the  nine  major  airfields  would  be 
blocked  at  the  low  level  of  the  Ground  Flotation  variable,  resulting  in 
a  discontinuity.  14  such  sites  were  identified  in  the  scenario  file. 

To  prevent  any  discontinuity,  the  scenario  file  needed  to  be 
modified  so  that  these  14  locations  were  linked  to  the  9  major 
airfields.  To  do  this,  the  location  of  the  9  airfields  were  mapped  onto 
graph  paper,  along  with  the  network  that  represented  the  links  of  the  14 
locations.  This  identified  the  nearest  major  airfield  to  each  of  these 
locations.  The  scenario  file  was  then  used  to  identify  E/D  sites  that 
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linked  the  major  airfields  to  the  airfields  that  were  linked  to  the  14 
sites.  For  all  14  sites,  it  was  possible  to  identify  a  path,  consisting 
of  existing  links,  that  linked  each  of  the  14  sites  to  at  least  one 
major  airfield. 

The  scenario  file  used  in  the  experiment  was  modified  to  include 
these  new  paths  as  additional  links.  The  transhipment  time  for  each  of 
the  new  links  was  the  sum  of  the  transhipment  times  of  each  of  the 
existing  links  along  the  new  path. 

Analysis  of  the  Main  Effects  of  a  IVfo  Level  Factorial  Design  (4:309-313) 

TWO  methods  for  analyzing  the  results  of  a  two  level  factorial 
expieriment  are  outlined  by  Box:  a  difference  between  two  averages  to 
determine  the  mean  value  for  each  effect,  and  Yate's  Algorithm.  The 
first  method  will  be  discussed  initially. 

Each  variable  in  the  experiment  was  tested  at  two  levels,  a  high 
level  and  a  low  level.  In  the  design  matrix,  the  high  levels  of  each 
variable  were  identified  by  a  '+'  sign  and  the  low  levels  by  a  sign. 
Using  the  difference  between  two  averages  method,  the  average  effect  of 
a  variable  was  calculated  by  subtracting  the  average  value  of  all  the 
experimental  results  for  which  the  particular  variable  was  from  the 
average  value  of  all  the  experimental  results  for  which  the  variable  was 
'+'.  The  result  is  a  value  that  represents  the  main  effect  of  that 
variable  on  the  output  measure. 

While  a  detailed  explanation  of  the  analysis  of  results  will  be 
discussed  in  following  sections,  in  simple  terms,  the  further  away  the 
value  of  the  effect  is  from  zero,  the  more  significant  is  the  effect  of 
that  variable. 
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Analysis  of  the  Interaction  Effects  of  a  TVio  Level  Factorial 
Design  (4:313) 

Interactions  between  variables  occur  v*ien  the  effect  of  one 
variable  is  not  ccaipletely  independent  of  other  variables.  Itiat  is, 
v*ien  the  effect  of  one  variable  on  the  outcome  of  the  experiment  is  a 
function  of  the  level  of  the  other  variables.  Factorial  designs  are 
able  to  estimate  the  effect  of  these  interactions. 

For  this  2^  experiment,  interactions  can  occur  as  a  result  of  two, 
three,  four,  five,  or  six  variables  interacting,  "flie  number  of  possible 
combinations  of  n  factor  interactions  in  this  experiment  is  given  by  the 
coTibi nation  formula: 


where  n  =  the  number  of  interacting  variables 

TTie  level  for  each  interaction  term  can  be  determined  by 
multiplying  the  signs  of  the  individual  interacting  variables  for  each 
experiment.  For  example,  for  a  two  factor  interaction  v^ere  both 
variables  are  at  a  low  level,  that  is,  and  the  two  factor 
interaction  term  is  at  the  '+'  or  high  level.  TTie  columns  for  all  the 
interaction  terms  in  the  2®  factorial  experiment  are  contained  in 
Appendix  D. 

The  calculation  of  the  average  effect  of  an  interaction  term  is 
the  same  as  for  the  main  effects  except  that  the  column  of  '+'  and 
signs  from  design  matrix  corresponds  to  the  appropriate  interaction  term 
rather  than  a  main  effect.  The  average  effect  of  an  interaction  term  is 
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found  by  subtracting  the  average  of  all  the  results  where  the 
interaction  level  was  low  {-)  from  the  average  of  all  the  results  viiere 
the  interactive  term  was  high  {+). 

Again,  an  interaction  term  is  significant  viien  the  effect  is 
significantly  different  from  zero. 

Yate's  Algorithm  (4:323-324) 

Yate's  algorithm  is  an  alternative  method  for  calculating  the 

effects  of  a  two  level  factorial  design.  Before  Yate's  algorithm  can  be 

applied,  the  results  of  the  experiment  need  to  be  arranged  in  a  standard 

order.  The  standard  order  for  a  2*^  factorial  design  is  where: 

the  first  column  of  the  design  matrix  consists  of  successive  minus 
and  plus  signs,  the  second  column  of  successive  pairs  of  minus  and 
plus  signs,  the  third  column  of  four  minus  signs  followed  by  four 
plus  signs,  and  so  forth.  In  general,  the  /cth  column  consists  of 
2*'^  minus  signs  followed  by  2'^’^  plus  signs.  (4:323) 

The  design  matrix  in  Table  3  is  laid  out  in  this  -standard  order. 

Results  from  the  experiments  are  aligned  in  the  order  given  by  this 

matrix.  An  example  of  the  calculations  involved  in  the  Yate's  algorithm 

is  given  in  Figure  8.  This  example,  taken  from  Box,  Hunter  and  Hunter, 

is  a  2^  factorial  experiment,  with  the  three  variables  identified  by  T, 

C,  and  K. 

The  values  for  the  top  half  of  the  first  column  of  Yate's 
algorithm  are  obtained  by  adding  successive  pairs  of  results  together. 
For  the  bottom  half  of  this  column,  values  are  calculated  by  subtracting 
successive  pairs  of  results,  with  the  top  number  of  each  pair  being 
subtracted  from  the  bottcxn  number  of  that  pair. 

Each  successive  column  of  the  algorithm  is  calculated  in  the  same 
manner,  using  the  values  of  the  preceding  column.  For  a  2*^  factorial 
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Figure  8.  Yate's  Algorithm  -  2^  Factorial  Experiment  (4:342) 


design,  k  columns  need  to  be  generated  in  this  manner.  Tbe  column  of 
estimates  is  calculated  using  the  kth  column.  Tbe  topmost  number  is 
divided  by  2^  to  produce  an  estimate  of  the  average  value  of  the  output 
measure  across  all  the  experimental  runs.  Tbe  remaining  numbers  are 
divided  by  2^'^  to  produce  estimates  for  the  effect  of  the  terms 
represented  by  the  plus  signs  cu  the  same  row  of  the  design  matrix. 
lYiese  terms  are  identified  in  the  right  hand  column  of  the  Yate's 
algorithm.  Ibe  terms  for  this  experiment  are  shown  in  Table  3  alcxigside 
their  corresponding  row  of  the  design  matrix. 

Analysis  of  the  Results  of  a  IVw  Level  Factorial  Experiment 

To  determine  v^ich  values  are  significant,  a  standard  error  needs 
to  be  calculated.  Hcx^ver,  because  each  output  measure  only  produces  a 
single  value  for  each  nin,  no  direct  calculation  of  can  be  made.  An 
estimate  of  the  standard  error  can  be  made  using  the  results  from  hi^er 
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order  interactions,  if  certain  assumptions  can  be  made.  Specifically, 
if  the  response  function  is  smooth  and  continuous,  as  was  assumed  in  the 
selection  of  the  factorial  design  for  this  analysis,  then  higher  order 
interactions  should  be  small.  The  higher  order  interactions  would  then 
"measure  differences  arising  principally  from  experimental  error" 
(4:327). 

The  variance  of  the  results  can  then  be  calculated  as  the  mean  of 
the  sum  of  squares  of  the  higher  order  interactions,  and  the  standard 
error  is  the  square  root  of  this  value.  For  this  experiment,  all  three, 
four,  five,  and  six  factor  interaction  terms  will  be  assumed  to  be 
negligible,  and  the  results  fran  all  these  terms  will  be  used  to 
determine  an  initial  estimate  of  the  standard  error  for  each  outp>ut 
measure  (4:327-328).  Once  the  standard  error  has  been  calculated,  the 
significant  terms  can  be  identified.- 

If  a  term  is  not  significant,  the  value  of  the  output  will  remain 
the  same  irrespective  of  the  level  of  that  particular  term.  Because  the 
estimate  of  the  effect  of  a  term  is  the  difference  between  the  average 
effect  of  the  term  at  a  high  level  and  the  average  effect  of  the  term  at 
a  low  level,  for  terms  that  are  not  significant,  this  estimate  will  be 
close  to  zero.  If  all  terms  are  negligible,  the  estimates  would  all 
represent  experimental  error,  and  for  a  large  enough  sample  of  results, 
would  be  normally  distributed  about  zero.  Therefore,  99.74%  of  all  the 
estimates  would  lie  within  three  standard  deviations  of  zero. 

An  estimate  which  lies  outside  three  standard  deviations  fran  zero 
is  most  lilcely  to  be  a  significant  term.  For  the  analysis  of  results 
for  this  experiment,  all  terms  with  estimates  that  have  an  absolute 
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value  greater  than  three  standard  deviations  from  zero  will  be 
considered  significant. 

Development  of  a  Regression  Model 

All  the  significant  terms  identified  by  the  previous  method  will 
be  used  to  develop  an  initial  regression  model  that  represents  the 
underlying  response  function.  This  regression  model  takes  the  form: 


where 


9  =  y 


(5) 


=  the  estimate  of  the  output 
y  =  the  estimate  of  the  average  output 
across  all  experimental  runs 
pg  =  the  estimate  of  the  effect  of  the 

nth  term  calculated  by  Yate's  algorithm 
Xg  »  the  nth  term 


In  the  factorial  design,  the  actual  estimate  of  the  effect,  By, 
measiares  the  change  in  the  estimated  result  when  the  variable,  x^, 
changes  from  -l  to  +l,  v^ich  is  a  change  of  two  units.  The  coefficients 
of  each  significant  term  in  the  regression  equation  represent  the  change 
in  the  estimated  result  v^en  the  vauriable,  x^,  is  changed  by  one  unit. 
Therefore,  the  coefficients  used  in  the  regression  equation  are  half  th^ 
estimated  effects  calculated  using  Yate's  algorithm  (4:514). 

The  regression  equation  can  be  used  to  calculate  estimates  of  the 
output  for  each  experimental  run  by  substituting  +1  or  -l  for  variables. 
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based  upon  the  level  of  each  variable  in  each  row  of  the  design  matrix. 
These  estimates  of  the  output  can  then  be  used  to  determine  the 
closeness  of  fit  of  the  estimated  regression  function  to  the  actual 
response  function.  The  value  of  the  residual  is  given  by: 

(6) 

where,  for  the  ith  observation, 

y^=  the  actual  result 
the  estimated  result 
Y  =  the  overall  mean 
the  residual 

Equation  6  states  that  the  residual  is  the  difference  between  the 
deviation  of  the  actual  results  from  the  overall  mean  and  the  deviation 
of  the  estimated  results  from  the  overall  mean.  Equation  6  can  be 
rewritten  as  follows: 

{Y^-Y)  =  +(7^-?^)  (7) 

By  squaring  both  sides  of  Equation  7  and  simplifying  the  resulting 
expression,  the  following  equation  is  obtained  (8:17-18): 

LiY^-Y)^  ~  (8) 

In  simpler  terms.  Equation  8  states  that  the  sum  of  the  squares 
about  the  mean  is  equal  to  the  sum  of  the  squares  due  to  the  regression 
plus  the  sum  of  the  squares  of  the  residuals. 
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Equation  8  will  be  used  to  construct  an  Analysis  Of  Variance 
(ANOVA)  table  which  will  provide  information  about  the  accuracy  of  fit 
of  the  regression  equation.  However,  in  addition  to  using  the  ANOVA 
table,  an  analysis  of  the  residuals  will  need  to  be  carried  out.  Two 
different  metnods  will  be  used  to  analyze  the  residuals:  a  plot  of  the 
residuals  against  the  predicted  responses  and  a  normal  probability  plot 
of  residuals. 

The  plot  of  residuals  against  the  predicted  responses  will  allow 
an  assessment  of  nonlinearity  and  of  non-constant  variance.  If  the  plot 
of  the  residuals  indicates  that  there  may  be  nonlinearity,  this  would 
indicate  that  higher  order  terms  are  required  in  the  regression 
equation.  (As  has  been  mentioned  previously,  a  two  level  factorial 
experiment  cannot  assess  curvature.)  Non-constant  variance  may  indicate 
that,  some  transformation  is  required  to  produce  a  better  fitting 
regression  equation.  The  normal  probability  plot  of  the  residuals  is 
used  to  check  that  the  residuals  are  normally  distributed. 

By  combining  the  analysis  of  the  ANOVA  table  with  the  analysis  of 
the  two  plots  of  the  residuals,  an  assessment  as  to  the  usefulness  of 
the  regression  equation  can  be  made.  This  procedure  will  be  carried  out 
for  each  of  the  six  measures  of  effectiveness  used  in  this  experiment. 

Development  of  a  Parsimonious  Model 

In  the  development  of  the  initial  regression  e<^  ^tions  for  each  of 
the  measures  of  effectiveness,  all  the  statistically  t*gnif leant  terms 
'^rould  be  included.  E^/en  though  higher  order  interactions  were  not 
ext-ected  to  be  significant,  there  may  still  be  a  large  number  of  terms 
contained  in  the  regression  equations.  Hcv/ever,  while  these  terms  may 
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be  statistically  significant  by  comparison  to  the  higher  order 
interactions,  they  may  not  significantly  contribute  to  the  regression 
model  being  developed.  For  the  final  analysis,  a  parsimonious  model  is 
required,  that  is,  a  model  that  uses  the  smallest  possible  number  of 
terms  but  still  provides  an  adequate  representation  of  the  function 
being  modeled. 

A  parsimonious  model  will  be  developed  for  each  of  the  output 
measures  using  a  stepwise  regression  methodology.  For  each  of  the 
parsimonious  models  developed,  an  ANOVA  table  and  the  plots  of  the 
residuals  will  be  used  to  assess  the  goodness  of  fit  of  the  model. 

Identification  of  Significant  Aircraft  Characteristics 

The  result  of  the  analysis  should  be  six  parsimonious  regression 
functions.  The  variables  in  these  six  regression  functions  represent 
the  set  of  aircraft  characteristics  that  are  most  significant  to  each  of 
the  measures  of  effectiveness. 

However,  the  explanation  of  the  significance  of  each  variable 
depends  upon  the  presence  of  that  variable  in  any  interaction  terms.  If 
a  variable  is  not  in  an  interaction  term,  then  that  particular  aircraft 
characteristic  directly  affects  the  result  of  the  given  output  measure, 
and  so  can  be  considered  significant.  If  a  variable  is  contained  in  an 
interaction  term,  irrespective  of  v^ether  or  not  it  also  appears  as  a 
single  term,  that  aircraft  characteristic  can  only  be  explained  in  terms 
of  the  interaction  of  that  characteristic  with  the  other  characteristics 
in  that  interaction  term. 
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Summary 


The  experimental  design  chosen  for  this  research  was  a  two  level 
full  factorial  design.  Forty  three  aircraft  parameters  in  GAMM  were 
grouped  into  five  experimental  variables:  Flight  Performance,  Cargo 
Cabin,  Inflight  Performance,  Groiond  Flotation/i'Jheel  Loading,  and 
Servicing  and  Aircraft  Loading/Unloading.  An  additional  variable. 
Aircraft  Numbers,  was  also  included.  The  experimental  design  used  for 
this  research  was  therefore  a  2^  factorial  design. 

Six  measures  of  effectiveness  were  selected.  Ratio  On  Time  and 
Ratio  Delivered  were  the  primary  measures  of  the  throughput  of  the 
tactical  airlift  system.  Four  secondary  measures.  Total  Flight  Hours, 
Total  Sorties,  Productive  Flight  Hours,  and  Productive  Sorties,  were 
selected  to  assess  the  efficiency  of  the  tactical  airlift  system. 

■  TVx)  methods  for  analyzing  the  results  were  presented:  the 
difference  between  two  averages  and  Yate's  algorithm.  Both  methods 
would  identify  terms  that  had  a  statistically  significant  effect  upon 
the  measure  of  effectiveness  when  the  level  of  that  term  changed  from 
high  (+)  to  low  (-).  For  each  measure  of  effectiveness,  all 
statistically  significant  terms  would  be  used  to  develop  an  initial 
regression  model.  From  this,  parsimonious  models  could  then  be 
developed. 

The  parsimonious  models  would  contain  the  smallest  possible  number 
of  terms  that  still  adequately  represented  the  underlying  response 
functions.  The  variables  contained  in  the  terms  of  the  parsimonious 
models  vjould  represent  the  set  of  aircraft  characteristics  that  had  the 
most  significant  effect  on  the  tactical  airlift  system. 
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V.  Verification  and  Validation 


Introduction 

Before  was  used  for  this  experiment,  it  was  necessary  to 
determine  the  extent  to  vAiich  the  model  had  been  verified  and  validated. 
Verification  of  a  canputer  simulation  is  concerned  with  ensuring  that 
the  canputer  program  is  performing  the  way  that  it  was  intended  to 
perform.  "If  the  input  parameters  and  the  logical  structure  of  the 
model  are  correctly  represented  in  the  code,  verification  has  been 
ccanpleted"  (3:14).  Validation  of  a  simulation  is  the  process  of 
determining  that  the  simulation  is  "an  accurate  representation  of  the 
real  system"  (3:14).  In  simpler  terms,  "validation  deals  with 
building  the  right  model,  verification  deals  with  building  the  model 
right"  (21:559). 

Verification  of  GAf'lM 

Verification  of  a  simulation  model  is  the  responsibility  of  the 
modeler  who  defines  the  model  specification  and  the  software  engineers 
who  program  the  model  (21:567-568).  It  is  an  essential  step  during  the 
development  of  a  simulation  model. 

No  documentation  about  the  initial  development  and  verification  of 
GAUM  was  available.  Also,  because  the  author  was  a  representative  of  a 
foreign  military  service,  the  source  code  for  GAMM  was  not  available  for 
analysis.  As  a  result,  the  extent  of  the  initial  verification  effort 
for  GANW  could  not  be  determined. 

However,  a  number  of  documents  provided  seme  insight  about  the 
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extent  of  verification  of  GAMM.  The  GA^f^  Prograinmer/Analyst's  Manual 
provided  extensive  detail  about  the  logic  used  within  the  model.  In 
particular.  Section  4  describes  the  most  significant  software  events  and 
routines,  and  supplemented  these  descriptions  with  flow  charts  that 
represented  the  way  the  actual  coding  of  the  event  or  routine  had  been 
carried  out  (9:Sec  4).  Section  Two  of  the  GAMM  User's  Manual  used  a 
simple  example  of  a  tactical  airlift  scenario  to  step  through  the  GAMM 
flight  scheduling  algorithm.  The  exanple  used  four  airbases,  seven  E/D 
sites  and  ten  aircraft  to  shOfi  the  sequence  of  movement  of  18  jobs 
through  the  tactical  airlift  system  to  their  final  destinations 
(10:Sec  2-16  to  2-30) . 

GAMM  has  evolved  from  a  simplistic  tactical  airlift  model  to  a 

more  elaborate  and  more  realistic  model  of  a  future  tactical  airlift 

system  (16;1).  The  first  version  of  GANW  to  be  developed  was  identified 

as  Version  0.5.  With  each  major  change  to  the  model  a  new  version  was 

released.  The  current  version  of  GAMM  is  Version  3.5.  In  1990,  a 

System  Concept  Evaluation  Baseline  analysis  was  undertaken  by  the 

developers  of  GAMM,  the  General  Research  Corporation  (GEC) .  The  purpose 

of  this  study  v/as  to  highlight  "the  enhancements  to  GAm  in  evolving 

from  GAMM  0.5  to  GAMM  3.4"  and  to  provide  "comparative  assessments  to 

illustrate  the  ramifications  of  current  algorithms"  (16:1). 

GRC  is  to  review  results  from  similar  runs  made  with  each  of  the 
two  versions  of  GAMM,  to  identify  significant  differences  between 
the  tvro  sets  of  results,  to  determine  and  explain  the  cause  of 
these  differences,  and  to  implement  corrective  action  to  resolve 
software  problems.  (16:1) 

This  baseline  analysis  and  comparative  assessment  was  used  to 
verify  the  performance  of  Version  3.4.  In  addition,  the  baseline 
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analysis  contains  a  list  of  all  the  modifications  made  to  GAI^  since  the 
original  version  (16:3-6). 

Version  3.5  differed  from  Version  3.4  in  that  one  paran^ter  was 
added  to  the  model.  The  new  parameter,  the  logistical  pipeline  delay, 
represented  the  time  it  would  take  a  Maintenance  Repair  Team  to  reach  an 
aircraft  that  had  broken  down  (25).  This  parameter  was  significant 
where  an  aircraft  had  broken  down  away  from  a  major  airbase,  and  had  the 
effect  of  increasing  the  total  time  required  to  repair  the  aircraft.  In 
all  other  aspects.  Version  3.5  is  identical  to  Version  3.4. 

Validation  of  GAMM  (25;  26) 

No  formal  validation  of  GAMM  has  been  Ccirried  out  (25),  However, 
in  1989,  ASD/XRM  tasked  GRC  to  carry  out  a  specific  series  of  tests  of 
GAMM.  The  purpose  of  these  tests  was  to  both  validate  and  verify  GA^®1, 
Version  3.0.  Eighteen  specific  categories  within  GAMM  were  tested. 
These  categories  included: 

1.  Airbase  preferences. 

2.  Airlifter  scheduling  and  relocation.  This  category  included  the 
selection  of  cargo  for  airlift,  calculation  of  reduced  payloads 
due  to  runway  conditions,  and  movement  item  priority  selections. 

3 .  Ai rdrops . 

4.  Fuel/payload  calculations. 

5.  Crev;  day  expiration. 

6.  Airlifter  performance,  including  fuel  usage  (26). 

The  results  of  these  tests  v/ere  presented  as  a  series  of  five 
tutorials  to  ASD/XRM.  The  conclusion  drawn  frcxn  these  tests  was  that, 
as  far  as  the  eighteen  categories  were  concerned,  GAMM  was  operating  as 
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expected  (26).  No  formal  report  of  these  test  results  was  published. 

In  addition,  the  continued  use  of  GAMM  by  ASD/XRM,  MAC,  Lockheed 
Aeronautical  Systems  Company,  Boeing  Military  Aircraft  Company,  and 
Douglas  Aircraft  Company  has  resulted  in  an  ongoing  process  of  face 
validation  and  improvement  of  the  model. 

Event  Validation  of  GANttl 

The  lack  of  formal  validation  made  it  necessary  to  confirm  that 
GAMM  performed  correctly  before  the  actual  experiment  was  carried  out. 
The  technique  used  to  assess  GAMM's  performance  was  event  validation. 
Event  validation  "eii^iloys  identifiable  events  or  event  patterns  as 
criteria  against  which  to  compare  model  and  system  behaviors"  (2:67). 

Rather  than  attempting  to  validate  all  aspects  of  the  model,  the 
purpose  c'f  the  event  validation  was  to  ensure  that  the  airlift  aspects 
of  GAMM  ^'perated  as  expected.  To  do  this,  a  number  of  simple  airlift 
jobs  were  created.  These  jobs  are  described  below. 

Cargo  Description.  GAMM  contains  a  number  of  standard  cargo  items 
that  hav^  predefined  dimensions  (9:Sec  2-9).  TVro  of  these  standard 
items  were  used  to  make  up  a  standard  aircraft  load; 

1.  Beik  Cargo  Pallets.  Bulk  cargo  463L  pallets  in  GAMM  weigh  4600 
11:^  and  are  104"  wide,  84"  long,  and  96"  high.  Two  bulk  cargo 
pa. lets  were  included  in  the  standard  aircraft  load. 

2.  Passenger  Pallets.  Passenger  pallets  are  a  notional  pallet  for 
the  purposes  of  the  model  and  are  defined  as  having  23 
passengers  in  a  box  that  is  104"  wide,  120"  long,  and  96"  high. 

The  vieight  of  a  passenger  pallet  is  5520  lbs.  A  single  passenger 
pallet  was  included  in  the  standard  aircraft  load. 
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■nie  total  weight  of  a  standard  load  was  14,720  lbs,  and  its  length  was 
288  inches.  This  standard  load  was  considerably  less  than  the  maximum 
load  carrying  capacity  of  the  C-130  and  only  used  about  60%  of  the  cargo 
cabin.  However,  the  intent  of  the  standard  load  was  not  to  test  GAMM's 
handling  of  aircraft  loads  near  the  maximum  capacity  of  the  aircraft, 
but  rather  to  see  how  a  more  typical  small  tactical  load  was  handled. 

Scenario  Description.  For  the  pirpose  of  this  event  validation, 
the  aircraft  characteristics  used  were  those  of  the  C-130H.  The  Central 
American  scenario  was  used,  making  available  16  aircraft  to  carry  out 
the  airlift  jobs.  TWo  major  airbases,  both  suitable  for  C-130 
operations  at  maximum  aircraft  weight,  were  selected  as  the  E/D  sites 
for  the  airlift  jobs.  Neither  of  these  airbases  were  the  Central 
American  bed-down  base  for  the  C-130  aircraft. 

Job  Description.  A  number  of  simple  jobs  were  developed  using  the 
standard  aircraft  load: 

1.  Job  1;  One  standard  load  moved  fran  one  E/D  site  to  another. 

2.  Job  2:  TWO  standard  loads,  one  at  each  E/D  site  to  be  moved  to  the 
other . 

3.  Job  3:  Four  standard  loads,  two  at  each  E/D  site  to  be  moved  to 
the  other. 

4.  Job  4;  40  standard  loads,  20  at  each  E/D  site  to  be  moved  to  the 
other . 

Expected  Results.  The  primary  output  measures  for  the  event 
validation  were  the  number  of  total  and  productive  sorties  generated  by 
each  job.  Assuming  that  one  standard  load  would  generate  one  productive 
sortie,  for  each  job,  the  maximum  number  of  productive  sorties  generated 
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were  expected  to  equal  the  number  of  available  standard  loads.  Hiis  was 
the  expected  result  for  Jobs  1  and  2.  However,  for  Jobs  3  and  4,  it  was 
anticipated  that  the  actual  productive  sorties  flown  would  be  fewer  than 
the  number  of  standard  loads  available.  This  was  because  a  standard 
load  did  not  fully  utilize  a  C-130,  and  it  was  expected  that  the 
loading  algorithm  would  make  more  effective  use  of  the  available 
capacity.  The  total  number  of  sorties  generated  was  determined  by 
adding  the  expected  number  of  relocation  flights  to  the  expected  number 
of  productive  sorties.  Table  4  summarizes  the  expected  results. 


Table  4.  GAMM  Event  Validatic.i  -  E5<pected  Sorties  Generated 

Productive  Sorties  Total  Sorties 
Job  1  1  3 

Job  2  2  6 

Job  3  '4  12 

Job  4  40  72 


Actual  Results.  For  each  job,  a  separate  job  file  was  created. 
GAm  was  then  run  with  each  respective  job  file  using  the  baseline 
scenario  file.  Each  run  lasted  for  five  days  and  only  one  repetition 
was  carried  out.  All  other  initializing  parameters  were  as  given  in 
Appendix  C.  The  results  of  these  runs  are  contained  in  Table  5. 


Table  5.  GAI-IM  Event  Validation  -  Actual  Sorties  Generated 

Productive  Sorties  Total  Sorties 
Job  11  3 

Job  22  6 

Job  34  8 

Job  4  43  74 
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Analysis  of  Results.  The  results  for  Jobs  1  and  2  were  as 


expected.  For  Job  3,  the  total  number  of  sorties  were  less  than 
expected.  The  output  report  for  this  run  indicated  that  only  two 
aircraft  had  been  used,  rather  than  the  expected  four  aircraft.  For 
this  job,  GAMM  was  optimizing  the  number  of  airlifters  being  relocated. 
Because  the  loads  at  each  base  were  less  than  two  full  aircraft  loads, 
only  a  single  aircraft  was  sent  to  each  base.  After  delivering  the 
first  load  to  the  other  base,  the  remaining  load  was  uplifted  and 
delivered.  By  using  only  two  aircraft,  the  number  of  unproductive 
sorties  flown  to  complete  this  job  was  four.  Had  four  aircraft  been 
used,  eight  unproductive  sorties  that  would  have  been  generated. 

Finally,  for  Job  4,  the  number  of  sorties  flown  was  slightly  higher  than 
expected.  The  output  report  indicated  that  it  had  taken  two  days  to 
completely  deliver  all  loads.  The  extra  sorties  resulted  frcsn  a  number 
of  aircraft  returning  to  their  home  base  because  the  crew  had  reached 
the  end  of  their  crew  duty  period  before  they  could  deliver  the  load. 

Summary 

No  documentation  was  available  concerning  the  initial  verification 
or  validation  of  GAMM.  However,  as  GAMM  was  modified  and  new  versions 
of  GAMM  v/ere  released,  a  series  of  tests  and,  later,  a  baseline  analysis 
were  carried  out  to  ensure  that  the  newest  version  of  GAMM  was  operating 
as  expected.  Both  studies  concluded  that  GA^W  was  performing  correctly. 
No  unexpected  results  or  problems  were  identified  by  either  study. 

Also,  the  continued  use  of  GAlf^l  by  ASD/XRM,  MAC,  and  three  major 
airframe  companies  indicates  that  has  a  certain  amount  of  face 

validity.  In  addition,  event  validation  techniques  were  used  to  confirm 
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that  the  airlift  aspects  of  GAMM  were  operating  as  expected.  The 
results  achieved  fran  the  four  jobs  used  in  the  event  validation  were 


either  as  expected  or,  if  not 
In  conclusion,  v^ile  no 
has  occurred,  all  assessments 
operating  as  expected. 


as  expected,  could  be  easily  explained, 
formal  verification  or  validation  of  GAMM 
of  GAMM  have  shown  that  the  model  is 
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VI .  Experimental  Findings  and  Analysis 


Calculation  of  The  Required  Number  of  Replications 

The  purpose  of  this  section  of  the  experiment  was  to  calculate  the 
minimum  number  of  replications  required  to  ensure  that  the  measures  used 
in  this  analysis  were  within  a  specified  level  of  accuracy. 

To  do  this,  ten  independent,  single  simulation  runs  were  carried 
out.  To  ensure  independence,  each  simulation  run  was  required  to  use  a 
different  random  number  stream  (3:421).  This  was  achieved  by  changing 
the  random  number  seed  for  each  run.  The  same  scenario  file  was  used 
for  all  nans.  This  scenario  file  was  identified  as  EXP00.D0. 

The  six  measures  of  effectiveness  that  were  selected  for  the 
experiment  were  used  to  produce  the  data  for  the  calculation  of  the 
minimum  number  of  replications.  However,  rather  than  using  ratio  on 
time  and  ratio  delivered,  the  actual  values,  in  tons,  were  used  for 
these  calculations.  The  results  of  the  ten  runs,  together  with  the 
random  number  seeds  used  in  each  run,  are  shown  in  Table  6. 

For  each  measure  of  effectiveness,  the  foil wing  calculations  were 
carried  out.  Beginning  with  the  results  from  Runs  1  and  2,  a  sample 
mean  and  a  sample  standard  deviation  were  calculated.  Then,  the  results 
frati  Runs  1,  2  and  3  were  used  to  calculate  another  sample  mean  and  ' 
sample  standard  deviation.  Next,  the  results  from  Runs  l,  2,  3  and  4 
were  used.  This  process  continued,  with  the  sample  size  increasing  by 
one  run,  until  all  ten  results  had  been  included. 

For  each  measure  of  effectiveness,  the  mean  over  all  ten  runs  was 
used  to  set  the  required  level  of  accuracy.  Not  knowing  hew  accuracy 
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Table  6.  GAMM  Model  Replications  -  Results  of  Ten  Independent  Runs 


Input  file  used  for  all  replications  was  EXP00.D0 


TONS  TONS  TOTAL  TOTAL  PRODUCTIVE  PRODUCTIVE 

ON  TIME  DELIVERED  FLT  HRS  SORTIES  FLT  HRS  SORTIES 


RUN 

1 

2124 

5759 

4049 

7291 

460 

845 

RUN 

2 

2158 

5907 

4021 

7294 

467 

865 

RUN 

3 

2175 

5723 

4073 

7426 

447 

831 

RUN 

4 

2152 

5801 

4040 

7305 

454 

847 

RUN 

5 

2167 

5785 

3993 

7226 

467 

863 

RUN 

6 

2104 

5792 

4107 

7431 

449 

835 

RUN 

7 

2183 

5830 

3999 

7184 

462 

851 

RUN 

8 

2159 

5888 

4061 

7289 

472 

872 

RUN 

9 

2158 

5794 

4083 

7290 

467 

865 

RUN 

10 

2142 

5828 

4066 

7312 

467 

862 

RANDOM  NUT'IBER 

SEEDS; 

RUN 

1 

PK=2016429302 

0TOER=613743814 

RUN 

2 

PK=2026429302 

0TOER=623743814 

RUN 

3 

PK=2036429302 

CrnffiR=633743814 

RUN 

4 

PK=2046429302 

0TOER=643743814 

RUN 

5 

PK=2056429302 

0THER=653743814 

RUN 

6 

PK=2066429302 

0TOER=663743814 

RUN 

7 

PK=2076429302 

0THER=673743814 

RUN 

8 

PK=2086429302 

0TOER=683743814 

RUN 

9 

PK=2096429302 

crrHER=693743814 

RUN 

10: 

PK=2 106429302 

OTHER=603743814 
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would  affect  the  number  of  replications  required,  a  number  of  different 
levels  of  accuracy  were  selected.  For  the  accuracy  level  to  be 
consistent  across  all  the  measures  of  effectiveness,  it  was  initially 
specified  as  a  percentage,  ranging  frc«n  1%  to  5%  of  the  mean.  The 
actual  value  was  then  calculated  for  each  measure  of  effectiveness  and 
used  as  the  value  for  e  in  Equation  3  reproduced  below. 


R  ^ 


^a/2,R-1^0 


(3) 


The  value  calculated  for  the  sample  standard  deviation  was  used  as 
the  value  for  S.. 

The  last  variable  needed  was  the  value  of  a,  which  represented  the 
probability  of  achieving  the  desired  level  of  accuracy.  For  all 
calculations,  a  v/as  selected  as  (l  -  0.95).  That  is,  for  a  given  number 
of  replications,  there  was  a  probability  of  0.95  that  the  results  were 
within  the  specified  accuracy  of  the  'true'  values.  Using  this  value  of 
a,  values  for  t  could  be  determined. 

Table  7  shows  an  extract  of  the  calculations  for  two  output 
measures.  Tons  On  Time  and  Tons  Delivered.  The  calculations  have  used 
an  accuracy  value  of  2%.  The  t  values  used  are  listed  at  the  bottom  of 
the  table.  A  complete  listing  of  the  results  of  all  the  calculations 
carried  out  is  contained  in  ;^pendix  E. 

The  Required  Number  of  Replications  -  Interpretation  of  Results 

Using  the  results  from  Table  7,  it  can  be  seen  that  for  four 
cumulative  runs,  the  number  of  runs  required  for  Tons  On  Time  is  2.45, 
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Table  7.  Extract  of  Calculations  for  Determining  the  Required  Number  of 
Replications 


NUMBER 

OF 

TONS 

NUMBEIR  OF 

TONS 

NUMBER  OF 

CUMULATIVE 

ON  TIME 

RUNS 

DELIVERED 

RUNS 

RUNS 

REQUIRED 

REQUIRED 

MEAN 

2141.00 

5833.00 

2 

STDS 

24.04 

50.36 

104.65 

130,91 

3 

^EAN 

2152.33 

5796.33 

3 

STDS 

25.96 

6.73 

97.51 

13.03 

4 

MEAN 

2152.25 

5797.50 

4 

STDS 

21.20 

2.45 

79.65 

4.75 

5 

MEAN 

2155.20 

5795.00 

5 

STDS 

19.51 

1.58 

69.20 

2.73 

6 

MEAN 

2146.66 

5794.50 

6 

STDS 

27.22 

2.64 

61.91 

1.87 

7 

MEAN 

2151.85 

5799.57 

7 

STDS 

28.39 

2.60 

58.09 

1.49 

8 

MEAN 

2152.75 

5810.62 

8 

STDS 

26.41 

2.10 

62.20 

1.60 

9 

MEAN 

2153.33 

5808.77 

9 

STDS 

24.76 

1.76 

58.45 

1.34. 

10 

MEAN 

2152.20 

5810.70 

10 

STDS 

23.62 

1.54 

55.44 

1.16 

e  =  2% 
a  =  95% 

43.044 

116.214 

n  = 

2 

3 

4 

5 

t(a/2,n-l)= 

12.706 

4.303 

3.182 

2.776 

6 

7 

8 

9 

10 

2.571 

2.447 

2.365 

2.306 

2.262 

and  for  Tons  Delivered  is  4.75.  This  indicates  that  four  replications 
are  sufficient  to  achieve  an  accuracy  for  Tons  On  Time  within  2%  of  the 
actual  value  with  a  probability  of  0.95.  However,  for  Tons  Delivered, 
the  value  of  4.75  indicates  that  more  than  four  replications  are 
required  to  achieve  this  level  of  accuracy.  Table  7  indicates  that  at 
leas^"  five  replications  would  be  required. 
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In  vjeneral ,  if  the  value  for  the  number  of  runs  required  is  larger 
than  the  number  of  runs  used  in  the  sample,  then  more  replications  are 
needed  to  achieve  the  indicated  level  of  accuracy.  If  the  value  for  the 
number  of  runs  required  is  smaller  than  the  number  of  runs  used  in  the 
sample,  then  the  required  level  of  accuracy  will  be  achieved  by  carrying 
out  as  many  replications  as  there  were  number  of  runs  in  the  sample. 

Table  7  also  shows  that  the  number  of  runs  needed  to  achieve  a 
specified  level  of  accuracy  changes  for  each  measure  of  effectiveness. 
Said  in  another  way,  for  a  given  number  of  replications,  the  accuracy  of 
each  measure  of  effectiveness  is  different.  This  is  evident  when 
comparing  the  calculations  for  different  levels  of  accuracy.  These 
calculations  are  contained  in  ;i^peadix  E. 

Because  no  level  of  accuracy  had  been  specified  for  the 
experiment,  the  aim  was  to  select  the  smallest  number  of  replications 
that  wuld  result  in  acceptably  high  accuracy  for  most  of  the  measures 
of  effectiveness.  From  the  results  in  Appendix  E: 

1.  Nine  replications  would  be  required  to  achieve  an  accuracy  of  1% 
for  four  of  tne  six  measures  of  effectiveness. 

2.  Five  replications  would  be  required  to  achieve  an  accuracy  of  2% 
for  four  of  the  six  measures  of  effectiveness. 

3.  Four  replications  would  be  required  to  achieve  an  accuracy  of  3% 
for  all  six  measures  of  effectiveness. 

Based  on  these  results,  each  design  point  in  the  experi’^ent  would 
be  replicated  five  times.  Using  five  replications  rather  than  nine 
would  increase  the  half  length,  e,  from  1%  to  2%,  but  it  would  also 
reduce  total  nm  time  by  44%.  The  slight  loss  of  accuracy  was 
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considered  a  reasonable  price  to  achieve  a  considerable  reduction  in 
total  runtime.  The  four  replication  option  was  not  selected  because  the 
slight  reduction  in  run  time,  from  5  to  4  replications,  was  not 
considered  to  be  worth  the  cost  of  an  additional  loss  of  accuracy. 

With  five  replications,  four  output  measures  would  be  accurate  to 
within  2%  at  a  95%  confidence  level:  Tons  On  Time,  Tons  Delivered,  Total 
Flight  Hours,  and  Total  Sorties.  The  other  two  measures.  Productive 
Flight  Hours  and  Productive  Sorties,  would  be  accurate  to  within  3%. 

Experimental  Results 

To  ensure  genuinely  replicated  runs  in  the  experiment,  different 
raiidom  number  seeds  were  used  for  each  run.  These  are  listed  in 
Appendix  F.  The  actual  results  from  the  64  runs  are  shown  in  Table  8. 

Each  measure  of  effectiveness  shows  considerable  variation  in 
range  across  the  64  runs: 

1.  Ratio  on  Time  varies  from  a  low  value  of  0.12  to  a  high  value  of 
0.49. 

2.  Ratio  Delivered  varies  from  a  low  value  of  0.26  to  a  high  value  of 
0.98. 

3.  Total  Flight  Hours  vary  from  594  to  5824. 

4.  Total  Sorties  vary  from  1980  to  11015. 

5.  Productive  Flight  Hours  vary  from  55  to  618. 

6.  Productive  Sorties  vary  from  321  to  1132 

For  the  two  main  measures  of  effectiveness.  Ratio  on  Time  and 
Ratio  Delivered,  the  higher  values  were  consistent  with  the  results 
achieved  in  the  ATITiA  C-130  deficiency  analysis  for  the  modified  C-130 
airlifter  (24:Sec  3.4  44-48). 
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Table  BA.  Experimental  Results  :  GAMM  Central  American  Scenario 
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EXP  29  --  +  +  +  -  0  38  0.92  742  2977  287  1028 

EXP  61  +-  +  +  +  -  0  42  0  92  813  3244  288  1049 

EXP  13  -  +  +  +  +  -  039  092  696  2801  265  941 

EXP  45  +  +  +  ++-  0  44  0  95  802  3143  279  990 
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EXP  60  +-  +  +  +  +  0  45  0  93  805  3169  288  1035 
EXP  12  -  +  >  +  +  f  043  094  687  2731  261  932 
EXP  44  +  +  +  +  +  0  49  098  799  3075  282  991 


The  results  for  each  measiare  of  effectiveness  were  used  to 


calculate  estimates  of  the  main  and  interaction  effects  of  the 
variables.  As  described  in  Chapter  IV,  two  methods  were  used:  Yate's 
Algorithm  and  the  Difference  between  Two  Averages.  The  calculations  for 
the  Yate's  Algorithm  are  contained  in  Appendix  G.  The  results  of  the 
Difference  between  Two  Averages  method  are  contained  in  Appendix  H. 

Each  method  should  produce  the  same  estimates  for  the  main  and 
interaction  effects  of  the  variables.  However,  both  methods  were  used 
to  ensure  the  accuracy  of  the  results. 

Transformation  of  Data 

When  large",  it  is  possible  that  some  form  of 

transformation  may  produce  a  "simplified  and  more  efficient 
representation"  (4:334).  The  results  of  the  experimental  runs  had  very 
large  differences  between  the  largest  and  the  smallest  values.  In 
addition,  the  initial  analysis  of  residuals,  using  a  plot  of  the 
residuals  against  the  predicted  results,  indicated  that  the  residuals 
were  heteroscedastic.  That  is,  the  residuals  displayed  non-constant 
variance,  with  the  standard  deviation  of  the  residuals  increasing  as  the 
value  of  the  predicted  result  increased. 

To  correct  the  possible  problems  that  this  would  cause  in  the 
analysis,  it  was  decided  to  transform  the  data  using  the  natural 
logarithm  transformation.  All  the  results  from  the  experiment  were 
converted  to  their  values  in  natural  logarithms.  These  values  are 
contained  in  Appendix  K.  The  transformed  results  were  then  used  to 
calculate  new  estimates  for  the  main  and  interactive  effects  of  the 
variables.  Again,  both  Yate's  Algorithm  and  the  Difference  between  TWo 
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Averages  methods  were  used.  For  the  transformed  results,  the 
calculations  for  the  Yate's  Algorithm  are  contained  in  Appendix  I,  and 
the  results  for  the  Difference  between  Tivo  Averages  are  contained  in 
Appendix  J. 

Identification  of  Significant  Terms 

;^pendix  J  also  lists  the  estimate  of  the  standard  error  for  each 
output  measure.  This  was  calculated  frcan  the  sum  of  squares  of  the 
estimates  of  all  the  three,  four,  five  and  six  factor  interaction 
effects. 

As  mentioned  in  Chapter  IV,  all  terms  whose  estimates  had  an 
absolute  value  greater  than  three  times  the  standard  error  were 
considered  to  have  a  statistically  significant  effect  on  the  value  of 
the  output.  These  terms  and  their  estimates  were  used  to  develop  a 
regression  model  for  each  measure  of  effectiveness.  The  regression 
model,  previously  discussed  in  Chapter  IV,  is  shovm  below. 


(5) 


vfhere 

P’  =  the  estimate  of  the  output 
y  =  the  estimate  of  the  average  output 
across  all  experimental  runs 
=  the  estimate  of  the  effect  of  the 

nth  term  calculated  by  Yate's  algorithm 
=  the  nth  term 
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Regression  equations  for  all  six  measures  of  effectiveness  were 
developed  using  the  estimates  produced  from  the  transformed  results. 
However,  to  compare  the  effect  of  the  transformation  on  the  analysis,  an 
additional  regression  equation  was  developed  for  one  measure.  Ratio  on 
Time,  using  the  original,  untransformed  results  of  the  experiment.  The 
seven  initial  regression  equations  are  listed  in  Figure  9  below. 

Using  these  seven  equations,  AMOVA  tables  were  constructed  and  an 
analysis  of  residuals  was  carried  out.  The  full  ANOVA  tables  and  the 
residual  plots  are  contained  in  Appendix  L.  However,  the  important 
values  frcm  the  ANOVA  table,  the  F  value  and  the  Adjusted  R^  value,  for 
the  seven  equations  are  summarized  in  Table  9  below. 


Table  9.  Summary  of  ANOVA  Tables  for  Initial  Regression  Equations 


MEASURE  OF  EFFECTIVENESS 


F  VALUE  ADJUSTED  R‘ 


Ratio  On  Time  Eqn  l 
Ratio  On  Time  .Ln)  ~  Eqn  2 
Rat i o  Deli vered  -  Eqn  1 
Total  Flight  Hours  -  Eqn  1 
Total  Sorties  -  Eqn  1 
Productive  Flight  Hours  -  Eqn  1 
Productive  Sorties  -  Eqn  1 


1443.848 

2331.128 

2446.741 

456.495 

284.491 

1524.693 

757.536 


0.995653 
0.997304 
0.997146 
0.984856 
0.972987 
0.995427 
0 . 989700 


The  results  from  the  ANOVA  table  indicate  that  all  seven  of  the 
regression  equations  provide  an  extremely  good  fit  of  the  actual 
results.  In  addition,  the  plots  of  residuals  for  the  seven  equations, 
shown  in  Appendix  L,  indicate  that  the  residuals  are  randomly  scattered 
about  zero,  and  the  normal  probability  plots  of  the  residuals  for  the 
seven  equations  closely  approximate  a  straight  line,  indicating  that  the 
residuals  are  approximately  normally  distributed  about  zero.  Overall, 
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Ratio  On  Time  Function  -  Equation  l 


y=0.239219+(0. 020313/2)A+(0. 006562/2)F+(0. 155938/2)C+(0. 148437/2 )G 
+  (0. 015312/2  )S+(0. 065938/2)0X0. 015313/2)AC+(0.007812/2)AG 
+(0.007812/2)CS+(0.010312/2)GS 


Ratio  On  Time  Function  -  Equation  2 


Ln(y)=-1.535428+(0. 069347/2)A+(0, 019679/2 )F+(0. 647986/2 )C 
+  ( 0. 6 12359/2 )  G^  ( 0. 05 2023/2  )S+(0. 090673/2  )0><-(  0.045037/2)  AC 
+( 0. 019679/2 )FG+(0.027544/2)GS+{0.018423)CIG 


Ratio  Delivered  Function  -  Equation  1 


Ln{y)=-0. 664018+(0. 03274/2 )A+(0. 025351/2 )F+(0. 643881/2 )C 
+ ( 0 . 633737/2 ) G+ ( 0 . 04 1477/2 ) S+ ( 0 . 027778/2 ) PG 
+  (  -0 . 088493/2  )OX  -0 . 024146/2  )AOX  -0 . 031459/2  )CGS 


Total  Flight  Hours  Function  -  Equation  1 


Ln(y)=7.163+(0.214/2)A+(-0.501/2)C+(-0.671/2)I+(0.607/2)G 
+(0.087/2)S+(0.112/2)CI+(-0.462/2)CG 
>(-0. 106/2 )IG+(0.054/2)ACI 


Total  Sorties  Function  -  Equation  1 


Ln (y ) =8. 197+(0. 205/2 )A+( -0.526/2)C+(0. 493/2 )G+(0. 084/2)5 
■f  ( 0 . 1 14/2 ) Cl +  ( -0 . 082/2 )  IG^ ( -0 . 365/2 ) CG+ ( -0 . 068/2 )  ACG 


Productive  Flight  Hours  Function  -  Ecruation  1 


Ln(y)=5.469+(0.115/2)A+(0.778/2)C+(-0.657/2)I+{0.851/2)G 
+  ( 0 . 124/2  )CI+ (  -0 . 547/2 )OX  -0 . 136/2 )  IG 
-t- (  - 0 . 080/ 2 )  AOX -0 . 089/ 2 )  CIG 


Productive  Sorties  Function  -  Equation  1 

Ln(y ) =6. 544+(0. 085/2 )A+(0.547/2)C+(0. 589/2 )G+(0. 107/2 )CG 
+  ( -0 . 1 22/ 2 )  IG+ ( -0 . 33/ 2 ) CG*- ( -0 . 055/2 )  ACG+ ( -0 . 08/2 ) CIG 


Legend: 


A.  Aircraft  Numbers  F.  Field  Performance 

C.  Cargo  Cabin  I.  Inflight  Performance 

G.  Ground  Flotation/Wheel  Loading 
S.  Servicing  and  Aircraft  Loading/Unloading 


Figure  9.  Initial  Regression  Equations 
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these  regression  equations  proved  to  be  extremely  accurate  statistical 
models  for  representing  the  results  of  each  measure  of  effectiveness. 

Identification  of  Relevant  Terms 

Although  the  models  were  very  accurate,  they  were  not  very  useful. 
As  can  be  seen  frcxn  Figure  9,  each  of  the  regression  equations  contained 
between  eight  and  ten  terms  and,  except  for  one  equation,  these  terms 
used  five  or  more  of  the  six  variables  in  the  experiment.  Four  or  five 
terms  of  each  equation  were  interaction  terms  and  all  but  one  equation 
contained  a  three  factor  interaction  term. 

The  initial  regression  equations  had  included  all  the 
statistically  significant  terms.  However,  while  these  terms  may  have 
been  significant  by  comparison  to  the  higher  order  interactions  used  to 
calculate  the  standard  error,  they  may  not  all  be  significant  to  the 
response  function  being  modeled. 

For  the  purpose  of  this  analysis,  parsimonious  models  were 
required.  Rather  than  developing  extremely  accurate  models,  this 
analysis  was  attempting  to  identify  the  smallest  number  of  significant 
terms  that  would  still  provide  an  adequate  representation  of  the 
response  function  for  each  measure  of  effectiveness. 

The  parsimonious  models  were  developed  in  the  following  manner: 

1.  Beginning  with  the  initial  regression  equation  for  each  measure  of 
effectiveness,  three  or  four  terms,  whose  coefficients  had  the 
smallest  absolute  values,  would  be  removed  from  the  equation. 

2.  New  ANOVA  tables  and  new  residual  plots  would  be  constructed  from 
these  reduced  equations. 
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The  results  from  the  reduced  equations  were  then  ccanpared  with  the 
initial  regression  equations  to  determine  whether  any  significant  terms 
had  been  removed.  If  the  results  showed  that  no  significant  terms  had 
been  removed,  this  process  was  repeated.  The  ANOVA  tables  and  the 
residual  plots  for  all  the  reduced  equations  that  were  developed  in  this 
manner  are  contained  in  Appendix  M. 

A  final  set  of  parsimonious  regression  equations  was  eventually 
developed  and  is  presented  in  Figure  10  below.  The  F  values  and  the 
Adjusted  R‘  values  from  the  ANOVA  tables  for  these  seven  equations  are 
summarized  in  Table  10  belcw. 


Table  10.  Summary  of  ANOVA  Tables  for  Parsimonious  Regression  Ekguations 


MEASURE  OF  EFFECTIVENESS 


F  VALUE 


ADJUSTED  R^ 


Ratio  On  Time  -  Eqn  5 
Ratio  On  Time  (Ln>  -Eqn  J 
Ratio  Delivered  -  Eqn  3 
Total  Flight  Hours  -  Eqn  3 
Productive  Flight  Hours  -  Eqn  3 
Total  Sorties  -  Eqn  4 
Productive  Sorties  -  Eqn  3 


754.795 

1210.546 

2109.084 

192.756 

434.984 

143.802 

300.056 


0.972896 

0.982935 

0.990137 

0.924042 

0.964977 

0.871897 

0.934363 


These  results  indicate  that  all  seven  of  the  parsimonious 
equations  provided  a  good  fit  ot  the  actual  results.  The  plots  of 
residuals  for  the  seven  equations,  shown  in  Appendix  M,  clearly  show  the 
effect  of  the  reduced  number  of  terms.  As  the  number  of  terms  were 
reduced,  the  number  of  values  that  were  possible  for  the  estimated 
result  decreased.  Five  of  the  equations  contain  only  two  variables, 
allowing  only  four  possible  values  for  the  estimated  result.  The 
residuals  v;ere  still  reasonably  well  scattered  about  zero,  even  tho’jh 
the  plots  were  distinctly  bunching  together,  as  expected,  around  the 
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Ratio  On  Time  Function  -  Equation  5 
^0.239219+(0. 155938/2)C+(0.148437/2)G+-(0. 065938/2  )CG 


Ratio  On  Time  Function  -  Equation  6 
Ln(y)=-1.535428+{0.647986/2)C+{0.612359/2)G+{0.090673/2)CG 

Ratio  Delivered  Function  -  Equation  3 
Ln(y)=-0.664018+(0.643881/2)C+(0.633737/2)G+(0.088493/2)CX3 

Total  Flight  Hours  Function  -  Equation  3 
Ln(y ) =7. 163+(-0. 501/2 )C+(-0. 671/2) I+{0. 607/2 )G+(-0. 462/2 )CG 

Productive  Flight  Hours  Function  -  Equation  3 
Ln(y ) =5. 469+(0. 778/2 )C+(-0. 657/2) I+(0.851/2)G+(-0. 547/2 )CX5 

Total  Sorties  Function  -  Equation  4 
Ln(y)=8.197+(-.526/2)C+( . 49 3/2 )G+( -.365/2 )CX3 


Productive  Sorties  Function  -  Equation  3 
Ln(y)=6.544+(0.547/2)C+{0.589/2)G+(-0.33/2)CG 


Legend:  A. 

C. 

F. 
I. 

G. 
S. 


Aircraft  Numbers 

Cargo  Cabin 

Field  Performance 

Inflight  Performance 

GrouTid  Flotation/Wheel  Loading 

Servicing  and  Aircraft  Loading/Unloading 


Figure  10.  Parsimonious  Regression  Equations 
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fewer  estimated  response  values.  The  normal  probability  plots  also  lost 
their  extremely  close  approximation  to  straight  lines  as  the  number  of 
terms  in  the  equations  decreased,  but  the  plots  were  still  reasonably 
straight.  This  indicated  that  the  values  of  the  residuals  could  not  be 
ccmpletely  attributed  to  random  noise,  and  that  some  factor  existed  that 
was  statistically  significant.  Since  all  the  terms  removed  from  the 
equation  had  been  statistically  significant,  this  result  vras  not 
surprising. 

All  the  coefficients  in  the  equations  for  Ratio  on  Time  and  Ratio 
Delivered  are  positive.  This  means  that  v^en  either  variable  is  changed 
from  a  low  level  to  a  high  level,  the  value  of  the  result  will  increase. 
If  both  variables  are  changed,  the  value  will  increase  by  an  even 
greater  amount  because  then  the  interaction  term  will  be  positive  as 
wel  1 . 

For  the  other  measures  of  effectiveness,  the  results  are  not  as 
clear  because  of  the  significant  interaction  term,  CG.  The  results  are 
more  clearly  shown  ’n  following  sections. 

Comparison  of  the  Transformed  Results 

As  mentioned  earlier  in  this  chapter,  the  calculations  for  the 
regression  analysis  of  Ratio  On  Time  were  carried  out  using  both  the 
original  results  from  the  experiment  and  the  transformed  results.  The 
purpose  of  this  canparison  iS  to  confirm  that  the  transformation  used 
did  provide  a  better  representation  of  the  response  function. 

The  two  initial  regression  equations  for  Ratio  On  Time,  listed  in 
Figure  9,  contain  3  common  terms.  Only  two  interaction  terms  in  each 
were  different.  These  different  terms  were  also  the  first  terms  removed 
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from  the  equations  as  the  parsimonious  models  were  being  developed,  and 
as  Figure  10  shows,  the  final  equations  contained  the  same  terms. 

To  determine  vrtiether  the  transformed  rodel  was  a  better  model,  it 
was  necessary  to  compare  the  results  from  the  ANOVA  tables  and  the 
residual  analysis  for  each  equation.  The  main  results  frcxn  the  ANOVA 
tables  are  reproduced  in  Table  11  below.  As  can  be  seen  in  Table  11, 
for  each  set  of  comparable  equations,  the  model  developed  from  the 
transformed  results  proved  to  be  a  better  model  than  the  model  developed 
from  the  untransformed  results.  By  canparing  the  residual  plots  in 
Appendices  L  and  M,  it  is  evident  that  the  problem  of  non-constant 
variance  that  existed  with  the  untransformed  residuals  has  been  largely 


Table  11.  Comparison  of  Results  for  Ratio  On  Time 


INITIAL  REGRESSION  EQUATION 
Ratio  On  Time  -  Eqn  1 

F  VALUE 

1443.848 

ADJUSTED  R‘ 

0.995653 

Ratio  On  Time  (Ln)  -  Eqn 

2 

2331.128 

0.997304 

FIRST  REDUCTION 

Ratio  On  Time  -  Eqn  3 

1061.041 

0.990192 

Ratio  On  Time  (Ln)  -  Eqn 

4 

2072.789 

0.994958 

FINAL  EQUATION 

Ratio  On  Time  -  Eqn  5 

754.795 

0.972896 

Ratio  On  Time  (Ln)  -  Eqn 

6 

1210.546 

0.982935 

solved  by  the  transformation,  further  confirming  that  the  transformation 
has  prodijced  a  better  model . 

Interpretation  of  Results 

For  four  of  the  six  measures  of  effectiveness,  the  parsimonious 
models  that  v;ere  developed  contained  only  three  terms.  These  three 
terms  contained  only  tv/o  of  the  six  variables  used  in  the  experiment. 
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The  two  variables  were  C,  the  cargo  cabin  size,  and  G,  the  aircraft's 
ground  flotation/wheel  loading.  The  models  for  the  other  two  measures 
of  effectiveness  both  contained  a  single  additional  term,  containing  the 
variable  I,  the  inflight  performance  of  the  aircraft. 

All  six  equations  contained  the  interaction  term  CG.  When 
interpreting  the  results  for  each  measure  of  effectiveness,  the  effects 
ci  the  variables  in  the  interaction  term  must  be  considered  jointly 
(4:328) . 

Ttie  high  and  low  levels  of  C  and  G  result  in  four  possible 
combinations  of  these  two  variables  within  the  interaction  term,  CG. 

From  the  64  runs  carried  out,  16  results  were  available  for  each  of  the 
four  combinations.  The  16  results  were  used  to  calculate  an  average 
value  for  each  ccxnbination  of  C  and  G  in  the  interaction  term.  For  each 
of  the  measures  of  effectiveness,  these  results  have  been  plotted  in  the 
figures  below.  The  top  line  in  each  of  the  figures  represents  the  high 
level  of  the  variable  C.  This  line  can  be  considered  to  represent  a 
large  tactical  airlifter.  The  lower  line  therefore  represents  a  small 
tactical  airlifter. 

Ratio  On  Time.  The  effects  of  the  two  variables,  C  and  G,  on  the 
results  for  the  Ratio  On  Time  are  shown  in  Figure  11  below.  The  effect 
of  the  interaction  is  clearly  seen.  Increasing  the  size  of  the  cargo 
cabin  results  in  a  much  greater  increase  in  the  ratio  of  cargo  delivered 
on  time  when  the  flotation  variable,  G,  is  at  a  high  level  rather  than  a 
low  level . 

Ratio  Delivered.  A  similar  result  is  shown  in  Figure  12  for  Ratio 
Delivered.  While  there  are  still  indications  of  the  effect  of  the 
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Figure  11.  Interaction  Effect  -  Ratio  On  Time 


interaction,  it  is  not  as  pronounced  as  in  Figure  11.  However,  the 
figure  does  show  that  significant  increases  in  the  ratio  of  cargo 
delivered  occur  when  either  variable  is  increased  from  its  low  level  to 
its  high  level,  and  the  greatest  increase  occurs  v^en  both  variables  are 
set  to  their  high  levels. 


Figure  12.  Interaction  Effect  -  Ratio  Delivered 
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Total  Sorties  Flown.  Figure  13  shows  the  results  for  this  measure 


of  effectiveness.  The  impact  of  the  interaction  term  on  the  results  of 
this  measure  of  effectiveness  is  extrenely  large.  Looking  at  Figure  13 
in  isolation  might  imply  that  a  large  aircraft  with  a  low  level  of  G 
will  fly  thousands  of  additional  sorties  trying  to  carry  out  all  the 
required  airlift  tasks.  By  changing  the  value  of  G  to  the  high  level, 
the  larger  aircraft  reduces  the  number  of  sorties  to  nearly  one  third  of 
the  previous  amount.  The  change  of  G  for  the  smaller  aircraft  also 
results  in  a  reduction  in  the  total  number  of  sorties  flcwn,  but  the 
reduction  is  small  compared  to  that  for  the  larger  aircraft. 


Flown 


Conparing  Figure  13  to  the  results  for  the  previous  two  figures 
reveals  the  true  effect  of  the  changes.  For  the  Icirger  aircraft,  the 
change  in  the  level  of  G  to  the  higher  level  not  only  reduced  the  total 
sorties  flown  to  one  third,  but  also  doubled  the  total  cargo  delivered 
and  the  total  cargo  delivered  on  time,  resulting  in  a  six  fold  increase 
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in  procJuctivity.  For  the  smaller  aircraft,  the  smaller  reduction  in 
total  sorties  together  with  the  doubling  of  the  total  cargo  delivered 
and  total  cargo  delivered  on  time  resulted  in  an  almost  three  fold 
increase  in  productivity. 

Productive  Sorties.  The  effects  of  the  variables  C  and  G  on  the 
number  of  productive  sorties  is  shown  in  Figure  14.  In  this  case,  the 
interaction  effect  appears  to  affect  the  smaller  aircraft  much  more  than 
the  larger  aircraft. 


Sorties  Flown 


Total  Flight  Hours.  From  the  regression  equation  in  Figure  10,  it 
can  be  seen  that  as  the  variable  I  changes  from  low  level  to  high  level, 
that  is,  as  the  inflight  performance  of  the  aircraft  inproves,  the  total 
flight  hours  decrease.  This  was  not  an  unexpected  result.  The  effect 
of  the  variables  C  and  G  is  shown  in  Figure  15.  As  expected,  these 
results  closely  match  the  results  for  Total  Sorties  Flcwn,  and  similar 
comments  can  be  made  about  these  results. 
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Figure  15.  Interaction  Effect  -  Total  Flight 
Hoxirs 


Productive  Flight  Hours.  The  regression  equation  for  Productive 
Flight  Hours  also  contains  a  negative  coefficient  for  the  variable  I. 
Hence  as  the  inflight  performance  improves,  the  number  of  productive 
flight  hours  will  decrease.  Figure  16  shows  the  effects  of  the  other 


Figure  16.  Interaction  Effect  -  Productive 
Flight  Hours 
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two  variables.  The  results  for  Productive  Flight  Hours  also  closely 
matches  the  result  for  Productive  Sorties  Flcwn. 

Analysis  of  the  Interact ioi.  Term 

The  presence  of  significant  interaction  terms  in  the  final  models 
was  not  anticipated.  That  the  same  interaction  term  should  occxar  in 
every  model  was  canpletely  unexpected.  The  only  reason  that  this  could 
have  occurred  would  be  due  to  some  significant  link  between  the  two 
variables  C  and  G. 

When  the  aircraft  parameters  that  made  up  these  two  variables  were 
initially  selected,  no  links  appeared  to  exist.  However,  on  closer 
examination,  a  possible  connection  was  identified.  The  variable  G 
contains  just  two  parameters,  both  LCN  values  that  GAMM  uses  to 
determine  whether  an  aircraft  can  operate  onto  a  given  airfield.  In 
addition  to  this,  GAMM  uses  the  LCN  values  to  determine  the  largest 
useful  load  that  can  be  supported  by  the  given  airfield  (9:Sec  3-1). 

One  value  of  LCN  is  given  at  the  maximum  useful  load  and  the  other  value 
of  LCN  is  given  at  zero  useful  load.  The  variable  C  contains  the  value 
of  maximum  useful  load.  Using  this  value,  GAMM  interpolates  between  the 
high  and  low  values  of  an  aircraft's  LCN  to  determine  the  maximum  load 
that  can  be  supported  by  a  given  airfield.  For  a  scenario  such  as 
Central  America  where  the  majority  of  the  airfields  are  restricted  by 
LCN  rather  than  by  runway  length,  the  aircraft's  LCN  values  and  its 
maximum  useful  load  become  very  important. 

This  link  between  maximum  useful  load  and  the  aircraft's  LCN 
results  in  the  very  significant  interaction  between  the  C  and  G 
variables. 
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Summary 


In  choosing  a  value  for  the  minimum  number  of  replications  for 
each  design  point  in  the  experiment,  a  trade  off  was  required  between 
the  desired  level  of  accuracy  of  the  results  and  the  total  run  time 
required  to  achieve  a  given  level  of  accuracy.  For  this  experiment, 
five  replications  were  selected.  For  four  of  the  measures  of 
effectiveness,  five  replications  would  result  in  an  accuracy  of  better 
than  2%  with  95%  confidence.  For  the  other  two  measures,  an  accuracy  of 
better  than  3%  could  be  achieved. 

The  analysis  of  the  experimental  results  produced  a  parsimonious 
model  for  each  of  the  six  measures  of  effectiveness.  Surprisingly,  all 
the  models  contained  the  same  two  variables:  the  Cargo  Cabin  variable  C, 
and  the  Ground  Flotation/Wheel  Loading  variable  G.  These  were  the  only 
variables  in  the  models  for  four  of  the .measures  of  effectiveness.  The 
models  for  the  other  two  measures.  Total  Flight  Hours  and  Productive 
Flight  Hours,  also  contained  one  other  variable.  Inflight  Performance. 

The  effect  of  Inflight  Performance  on  Flight  Hours  was  as 
expected.  An  increase  in  the  Inflight  Performance  reduced  the  number  of 
hours  flown.  The  effect  of  the  variables  C  and  G  on  each  of  the 
measures  of  effectiveness  could  not  be  as  easily  explained  because  all 
the  models  contained  these  variables  in  an  interaction  term. 

However,  for  the  two  primary  measures  of  effectiveness.  Ratio  On 
Time  and  Ratio  Delivered,  it  was  clear  that  a  significant  improvement  in 
the  throughput  of  the  tactical  airlift  system  could  be  achieved  by  using 
aircraft  with  a  high  level  of  C  and  a  high  level  of  G. 
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VII .  Conclusions  and  ReccCTmendations 


Summary  of  Experiment 

Ttie  purpose  of  this  study  was  to  identify  a  specific  set  of 
tactical  airlifter  characteristics  that  would  result  in  the  greatest 
inprovement  in  tactical  airlift  capability.  The  Generalized  Air 
Mobility  Model  (GAMM)  was  used  to  simulate  a  tactical  airlift  system 
operating  within  a  predetermined  scenario  in  Central  America. 

Because  the  response  of  the  airlifter  characteristics  on  tactical 
airlift  capability  was  not  known,  a  two  level  full  factorial 
experimental  design  was  chosen  to  carry  out  the  screening  experiment.  A 
large  number  of  significant  aircraft  parameters  were  available  in  GAMM. 
Because  it  was  not  possible  to  test  each  individual  parameter  using  a 
two  level  full  factorial  experiment,  it  was  decided  that  the  existing 
parameters  would  be  grouped  in  five  functional  sets,  identified  as  Field 
Performance,  Cargo  Cabin,  Inflight  Performance,  Ground  Flotation/Wheel 
Loading,  and  Servicing  and  Aircraft  Loading/Unloading.  These  five  sets 
became  five  of  the  six  variables  used  in  the  experiment.  The  sixth 
variable  used  in  the  experiment  was  Aircraft  Numbers. 

After  the  experimental  runs  had  been  carried  out,  the  results  were 
transformed  and,  for  each  of  the  measures  of  effectiveness  that  had 
ii.itially  been  selected,  a  parsimonious  model  was  developed.  The 
variables  remaining  in  these  models  identified  the  set  of  aircraft 
parameters  that  were  found  to  be  significant. 
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Results 


Tvk)  variables  appeared  in  all  six  of  the  models  developed.  FOr 
four  of  the  six  models,  only  these  tvK>  variables  were  present  in  the 
terms  of  the  model.  In  the  other  two  models,  only  one  additional 
variable  was  present.  The  variables,  and  the  aircraft  parameters  that 
made  up  those  variables  are  listed  in  Table  12  below. 


Table  12.  Summary  of  Significant  Airlifter  Characteristics  -  Central 


American  Scenario 
EXPERIMENTAL  VARIABLE 
Cargo  Cabin  (C) 


Ground  Flotation/Wheel  Loading  (G) 


AIRCRAFT  PARAMETTER 

Cargo  Bay  Width 

Cargo  Bay  Height 

Cargo  Bay  Length 

Cargo  Bay  Door  Width 

Cargo  Bay  Door  Height 

crOL  Max  Useful  Load 

crOL  Mid  Useful  Load 

Maximum  Cabin  Payload 

Aircraft  Spot  Factor 

Cargo  Threshold  for  Relocation 

LCN  -  Max  Useful  Load 
LCN  -  At  Zero  Useful  Load 


Inflight  Performance  (I) 


Maximum  Ferry  Fuel 
Cruise  Fuel 
Cruise  Speed 

Takeoff /Landing  Fuel  Bias 


The  variables  C  and  G  were  the  only  variables  in  the  models  that 
represented  Ratio  On  Time,  Ratio  Delivered,  Total  Sorties  Flown  and 
Productive  Sorties.  All  three  variables  appeared  in  the  nxxlels  for 
Total  Flight  Hours  and  Productive  Flight  Hours. 

While  the  three  variables  were  significant  to  the  models  that  were 
developed,  all  the  parameters  identified  in  Table  12  may  not  necessarily 
be  significant  to  tactical  airlift  capability.  The  design  of  the 
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variables  for  the  experiment  resulted  in  the  grouping  of  these 
parameters,  so  it  was  not  possible  to  distinguish  between  the  effects  of 
parameters  within  a  group.  To  identify  individual  parameters  that  are 
significant,  another  experiment  would  be  required. 

Implications  of  these  Results 

For  a  tactical  airlift  scenario  similar  to  Central  America,  where 
there  are  many  small  unprepared  strips  available,  these  results  indicate 
that  a  significant  increase  in  throughput  can  be  achieved  for  a  tactical 
airlift  system  by  increasing  the  size  of  the  aircraft's  cargo  cabin  and 
at  the  same  time  improving  the  aircraft's  ability  to  operate  on 
unprepared  airfields.  A  significant  increase  in  throughput  will  result 
in  a  greater  number  of  tactical  airlift  jobs  being  completed  on  time, 
and  a  greater  number  of  airlift  jobs  being  deUvered  overall. 

More  importantly,  these  results  show  that  improving  other  aircraft 
characteristics,  such  as  cruise  speed  or  a  very  short  take-off  and 
landing  capability,  would  not  significantly  improve  the  throughput  of 
the  tactical  airlift  system  in  the  scenario  studied. 

Thus,  this  research  identified  the  areas  of  tactical  airlifter 
development  that  will  result  in  significant  benefits,  as  well  as  those 
that  would  be  marginally  useful  for  this  type  of  scenario. 

Recommendations  for  Further  Resecirch 

This  study  conducted  an  initial  screening  of  tactical  airlifter 
characteristics.  A  number  of  areas  are  reccxiimended  for  further 
research . 
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1. 


Ti/elve  parameters  were  identified  as  belonging  to  the  two  main 
variables  identified  in  this  research.  Given  that  this  study 
found  that  higher  order  interaction  terms  were  not  significant,  it 
should  be  possible  to  design  a  fractior.ol  factorial  experiment 
such  as  a  2^^'®  design  that  would  be  able  to  identify  vAiich  of 
these  twelve  parameters  are  significant. 

2.  On  a  more  general  level,  this  study  made  a  number  of  initial 
assumptions  that  meant  important  aspects  of  the  tactical  airlift 
model,  such  as  attrition  and  maintainability/reliability,  were  not 
considered  at  all.  These  parameters  could  be  grouped  into  a 
number  of  variable  sets  as  was  done  in  this  study.  The  parameters 
in  the  three  variables  that  were  found  to  be  insignificant  in  this 
study  could  be  ignored.  The  significant  variables  identified  in 
this  research  and  the  new  variables  would  then  be  the  basis  for 
further  research  to  determine  how  attrition  and  maintainability 
and  reliability  issues  affect  the  tactical  airlift  system. 

3.  One  major  limitation  of  the  research  was  that  it  only  used  a 
single  scenario.  The  results  fron  this  research  therefore  have 
tended  to  optimize  the  performance  of  the  tactical  airlifter  for 
just  this  scenario.  Since  it  seems  improbable  that  a  new 
airlifter  will  be  designed  just  for  this  environment,  it  is 
reccmmended  that  further  research  be  carried  out  using  the  other 
available  scenarios  of  Southwest  Asia  or  Europe.  Once  additional 
scenarios  have  been  assessed,  it  may  be  possible  to  identify 
tactical  airlifter  characteristics  that  result  in  an  increase  in 
throughput  across  all  the  scenarios.  It  may  also  be  possible  to 
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identify  which  particular  characteristics  are  scenario  dependent 
and  are  more  important  in  one  scenario  than  another.  It  may  then 
be  possible  to  identify  a  set  of  characteristics  for  a  tactical 
airlifter  that,  if  put  together  in  one  aircraft,  would  result  in  a 
tactical  airlifter  that  performs  well  in  all  scenarios. 

4.  One  additional  area  for  further  research  is  the  GAMM  model  itself. 
The  GAMM  model  is  a  very  powerful  tool  for  analyzing  tactical 
airlifters.  However,  during  this  research,  it  was  only  possibi.j 
to  use  a  small  fraction  of  its  capability.  In  particular,  very 
little  experimentation  was  done  with  the  parameters  used  in  the 
initialization  of  the  model.  Changes  to  some  of  these  parameters, 
such  as  the  priority  scheduling  factor  may  have  significant 
effects  on  the  outcome  of  the  model.  Further  research  is  needed 
in  this  area  to  better  define  how  GAMM  responds  to  changes  in 
these  parameters. 
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Appendix  A:  GAMM  Airlifter  Characteristics  -  Baseline  C-130H 


AIRLIFTER  TYPE 

C130H 

-  SEA  LEVEL  - 

-  5000 

EFET  - 

HOT 

COLD 

HOT 

COLD 

103  F 

59  F 

84  F 

41  F 

CTOL  MAX  USEFUL  LOAD  (LBS) 

72000 

72000 

72000 

72000 

CTOL  TO  AT  MAX  USEFUL  LOAD  (FT) 

3580 

2680 

4070 

3440 

CTOL  LD  AT  MAX  USEFUL  LOAD  (FT) 

2280 

2150 

2570 

2430 

CTOL  MID  USEFUL  LOAD  (LBS) 

37000 

37000 

37000 

37000 

CTOL  TO  AT  MID  USEFUL  LOAD  (FT) 

1980 

1620 

2340 

2010 

CTOL  LD  AT  MID  USEFUL  LOAD  (FT) 

1890 

1800 

2100 

2000 

CTOL  TO  AT  ZERO  USEFUL  LOAD  (FT) 

1080 

950 

1240 

1110 

CTOL  LD  AT  ZERO  USEFUL  LOAD  (FT) 

1500 

1420 

1640 

1530 

VTOL  MAX  USEFUL  LOAD  (LBS) 

0 

0 

0 

0 

LCN  -  MAX  USEFUL  LOAD  (NO) 

39 

LCN  -  AT  ZERO  USEFUL  LOAD  (NO) 

18 

MAXIMUM  FERRY  FUEL  (LBS) 

59970 

MAXIMUM  CABIN  PAYLOAD  (LBS) 

50800 

CRUISE  FUEL  (LBS/HR) 

CRUISE  SPEED  (KNOTS) 

236 

CARGO  BAY  WIDTH  (INCH) 

107 

CARGO  BAY  HEIGHT  (INCH) 

102 

CARGO  BAY  LENGTH  (INCH) 

503 

CARGO  BAY  DOOR  WIDTO  (INCH) 

120 

CARGO  BAY  DOOR  HEIOfT  (INCH) 

109 

MISSION  ESSENTIAL  FHBF  (HRS) 

2.34 

NON  MISN  ESSENTIAL  FHBF  (HRS) 

999.00 

MEAN  TIME  TO  REPAIR  (HRS) 

2.40 

MITR  STANDARD  DEVIATION  (NO) 

0.83 

MEAN  TIME  TO  SERVICE  (HRS) 

0.50 

MTTS  STANDARD  DEVIATION  (NO) 

0.05 

MEAN  TIME  TO  LOAD  (HRS) 

1.00 

MTTL  STANDARD  DEVIATION  (NO) 

0.10 

LOAD  FAC  FOR  ROLLING  STOCK  (NO) 

0.50 

MEAN  TIME  TO  UNLOAD  (HRS) 

0.25 

MTTU  STANDARD  DEVIATION  (NO) 

0.03 

UNLD  FAC  FOR  ROLLING  STOCK  (NO) 

0.50 

MEAN  TIME  TO  REPAIR  BATTLE  DAMAGE 

(HRS) 

92.50 

MTTRBD  STANDARD  DEVIATION  (NO) 

102.80 

AIRCRAFT  SPOT  FACTOR  (NO) 

1.00 

VULNERABILITY  EXPONENT  (NO) 

1.00 

RESERVE  FUEL  (HRS) 

1.00 

TAKEOFF/LANDING  FUEL  BIAS (LBS) 

1500.0 

PAYLOAD  MARGIN  NEXT  FLT  (LBS) 

1000. 

TAXI,  TAKEOFF  &  LANDING  TIME  (HRS) 

0.25 

CARGO  THRSHLD  FOR  RELOCATION  (LBS) 

15000. 

PALLET  ROTATION  FLAG 

NO 
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Job  Closure  Pr'ty  -Total  Tons-  Average  Largest  Dimensions  Threat  (Km) 


Appendix  B:  Airlift  Jobs  for  Central  American  Scenario  (22:Sec  4-8) 
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C:  GAMM  Initialization  Sequence  -  Baseline  Parameters 

GENERALIZED  AIR  MOBILITY  MODEL 
(GAMM) 


RELEASE  3  VERSION  5 

DATE  OF  LAST  REVISION 
09/04/90 


ENTER  CARRIAGE  RETURN(CR)  TO  CONTINUE 

INTERACTIVE  GRAPHICS  (Y/N)?  N 

CURRENT  DEFAULT  DISK  =  DEFAULT: .DAT 
CHANGES  (Y/N)?  N 

IS  A  NEW  CHAIN  OF  SCENARIO  INPUTS  TO  BE  CREATED( Y/N)  ?  N 

ARE  INPUTS  TO  BE  FRC»1  AN  EXISTING  SCENARIO  FILE  (Y/N)?  Y 

IS  FILE  A  CHAIN  OF  SCENARIOS  OR  A  SINGLE  SCENARIO(C/S) ?  S 

ENTER  ID  OF  THE  SINGLE  SCENARIO  >  CW1RUN03.D0 

THIS  SCENARIO  HAS  A  PREDETERMINED  NUMBER  OF 
AIRLIFTER  TYPES,  AIRBASES,  E/D  SITES,  AIRLIFTERS, 

AND  FLIGHT  PLANNING  TIMES. 

DO  YOU  NEED  TO  CHANGE  THESE  (Y/N)  ?  N 

INCREMENTAL  CHANGES  DURING  SIMULATION(Y/N) ?  N 

JOBS  FILE  (Y/N)?  Y 

ENTER  JOBS  FILE  ID  >  CAMJOBS.XRM 

CURRENT  NUMBER  OF  JOB  TYPES  =  16 

ADD  MORE  (Y/N)?  N 

STANDBY  -  READING  DATA 

INPUT  DATA  MENUS; 

1  FOR  ENTRY/DELIVERY  SITE  DATA 

2  FOR  AIRFIELD  CHARACTERISTICS 

3  FOR  AIRLIFTER  CHARACTERISTICS 
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1 1 1 1 1 


4  FOR  AIRLIETER  PERFORMANCE  CHECK 

5  FOR  AIRLIFTER  PS  DATA 

6  FOR  TRANSPORTATION  ARC  DATA 

7  FOR  SURVIVABILITY  JOB  SCHEDULER 

8  FOR  FLIGHT  SCHEDULE 

9  FOR  JOB  DESCRIPTIONS 

10  FOR  MOVEMENT  REQUESTS 

11  FOR  JOB  DELETION  CONDITIONS 

12  FOR  INITIAL  CONDITIONS 

13  FOR  SAVING  DATA 

14  TO  CONTINUE 

15  TO  STOP/END/EXIT 
ENTER  RESPONSE  >  14 

LENCTH  OF  SIMULATION  IN  DAYS  (XX.)  >  30. 

NUMBER  OF  REPETITIONS  (1)  >  5 
CREW  DAY  IN  HOURS  {XX. X)  >  12. 

TIME  OF  DAY  FOR  AVERAGE  AIRBASE  TEMPERATURE  (HH:MM)  >  13:00 

PS  BOUND  FOR  TAKEOFF  ASAP.  NOTE  THAT  LOADING  AND  TAKEOFF  WILL 
ALWAYS  OCCUR  ASAP  IF  A  VALUE  OF  1.0  IS  ENTERED.  ALSO  NOTE  THAT  AN 
AIRBASE  CAN  NOT  BE  A  HOME  BASE  IF  ITS  24  HOUR  AIRCRAFT  GROUND 
SURVIVABILITY  IS  LESS  THAN  THE  VALUE  ENTERED  HERE  (OR  IT  DOES  NOT  HAVE 
FUEL) . 

ENTER  VALUE ( .XX)  >  .998 

WHEN  TAKEOFF  IS  ASAP,  A  FACTOR  CAN  BE  ENTERED  TO 
DECREASE  NORMAL  SERVICE,  LOAD  AND  UNLOAD  TIMES. 

ENTER  FACTOR  (.XX)  >  1.0 

WHEN  TAKEOFF  IS  ASAP,  A  FACTOR  CAN  ALSO  BE  ENTERED  TO 
DECREASE  MISSION  ESSENTIAL  MAINTENANCE  TIME. 

ENTER  FACTOR  ( .XX)  >  .5 

AIRCRAFT  SCHEDULING  BY  HIGH  PS  OR  HIGH  INPUT(P/I)?  I 
C130H  FLIOfT  SCHEDULE  PRIORITY(X.X)  >  2. 

NORMALLY  FLIGHTS  TO  DESTINATION  AIRBASES  ARE  SELECTED  AS  A  FUNCTION  OF 
BACKLOGGED  CARGO  WEIOfT.  ONCE  SELECTED,  AIRCRAFT  ARE  LOADED  AS  A 
FUNCTION  OF  JOB  PRIORITY. 

IS  THIS  SCHEDULING  APPROACH  SATISFACTORY{Y/N) ?  N 
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NOBMAL  SCHEDULING  AND  RELOCATION  WILL  BE  BYPASSED  FOR  JOBS  HAVING  A 
PRIORITY  HIGHER  THAN  OR  EQUAL  TO  THE  NUMBER  SELECTED 
(SMALLER  OR  EQUAL  IN  NUMERICAL  VALUE) . 

ENTER  PRIORITY  NUMBER  (XX)  >  4 

PS  RESTRICTED  SCHEDULING( Y/N) ?  N 

INDIVIDUAL  AIRLIFT  JOBS  PRINTOUT( Y/N)  ?  N 

SCENARIO  STRUCTURE  PRINTOUT( Y/N) ?  N 

PROGRAM  MODIFIED  SCENARIO  STRUCTURE  PRINTOUT! Y/N)  ?  N 

AIRBASE  CHARACTERISTICS  PRINTOUT! Y/N) ?  N 

AIRLIFTER  CHARACTERISTICS  PRINTOUT! Y/N) ?  N 

OPERATIONAL  PARAMETERS  PRINTOUT! Y/N) ?  N 

USE  WT  &  VOL  LOAD  MODULE! Y/N)?  Y 

NOTE!  ALL  NON-STANDARD  JOBS  MUST  BE  DIMENSIONED  FOR 
THIS  MODE.  SINCE  THE  WT  AND  VOL  LOADING  MODULE  REQUIRES 
SC>E  CPU  TIME  TO  ACCOMPLISH  AIRLIFTER  LOADING,  SLIGHTLY 
MORE  CPU  TIME  WILL  BE  REQUIRED  TO  RUN  IN  THIS  MODE. 

THE  PROGRAM  CC»4PARES  THE  BELOW  INPUT  VALUE  !TDNS)  TIMES  AIRBASE  MOG  TO 
THE  TOTAL  IN-BOUND  PLUS  BACKLOGGED  JOBS  AT  AN  AIRBASE  AND  STEP-WISE 
SCHEDULES  MOVEMENTS  TO  AIRBASES  IN  ORDER  TO  UNIFORMLY  DISTRIBUTE  JOBS  AS 
A  FUNCTION  OF  AIRBASE  MOG  !THE  SMALLER  THE  INPUT  VALUE,  THE  MORE  UNIFORM 
THE  DISTRIBUTION)  .  A  VALUE  LESS  THAN  3  TONS  IS  SET  TO  3  TONS. 

ENTER  VALUE  IN  TONS  !XXXXX)  >  25 

MEAN  TIME  !DAYS)  TO  ELIMINATE  BLOCKED  AIRCRAET!XX.X)  >  2. 

ENTER  MINIMUM  SPOTS  FOR  TRANSIT  AIRCRAFT! XX. )  >2.2 

SEED  FOR  PK  CALCULATIONS  ! DEFAULT)?  <CR> 

SEED  FOR  OTHER.  CALCULATIONS  ! DEFAULT)?  <CR> 

ir-MEDIATE  TAKEOFF  WITH  RELOCATION  AUTHORIZED! Y/N)  ?  Y 

GENERALIZED  SUMMARY  DATA  IS  ALWAYS  SAVED 
ENTER  ID  OF  FILE  >  RUN03OUT.LIS 

STANDBY  -  INITIALIZING  SIMULATION  PARAMETERS 

SIMULATION  TIME  =  DAY  1 
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Appendix  D;  Design  Matrices  for  Interaction  Terms 


Table  13 A.  Two-Factor  Interaction  Design  Matrix 


Test 

Condition 

AF 

AC 

AI 

AG 

AS 

FC 

FI 

FG 

FS 

CI 

CG 

cs 

IG 

IS 

GS 

Number 

1 

Run  No 
EXP  19 

+ 

+ 

+ 

+ 

+ 

4 

+ 

+ 

4 

4 

+ 

+ 

4 

+ 

4 

2 

EXP  51 

- 

- 

- 

- 

- 

+ 

+ 

4 

4 

4 

+ 

4 

4 

4 

4 

3 

EXP  03 

- 

+ 

+ 

4 

4 

- 

- 

- 

- 

4 

4 

4 

4 

4 

4 

4 

EXP  35 

+ 

- 

- 

- 

- 

- 

- 

- 

- 

+ 

+ 

4 

+ 

+ 

4 

5 

EXP  27 

+ 

- 

4 

+ 

- 

+ 

4 

+ 

- 

- 

- 

+ 

+ 

4 

6 

EXP  59 

- 

+ 

- 

- 

- 

- 

+ 

+ 

+ 

- 

- 

- 

4 

4 

4 

7 

EXP  11 

- 

- 

+ 

4 

4 

+ 

- 

- 

- 

- 

- 

- 

4 

+ 

4 

8 

EXP  43 

+ 

- 

- 

- 

4 

— 

- 

- 

- 

- 

- 

+ 

4 

+ 

9 

EXP  23 

+ 

- 

4 

+ 

4 

- 

+ 

+ 

- 

4 

4 

- 

- 

4 

10 

EXP  55 

- 

- 

- 

- 

+ 

— 

4 

+ 

- 

+ 

4 

_ 

- 

4 

1 1 

EXP  07 

- 

+ 

- 

+ 

+ 

- 

+ 

_ 

- 

- 

4 

4 

_ 

- 

4 

12 

EXP  39 

+ 

- 

+ 

- 

- 

- 

+ 

- 

- 

- 

+ 

+ 

- 

- 

4 

13 

EXP  31 

+ 

- 

- 

+ 

+ 

- 

- 

+ 

+ 

+ 

- 

- 

- 

- 

+ 

14 

EXP  63 

- 

+ 

+ 

- 

- 

- 

— 

+ 

+. 

+ 

- 

- 

- 

- 

+ 

15 

EXP  15 

- 

- 

- 

+ 

+ 

4 

+ 

- 

- 

+ 

- 

- 

- 

- 

4 

16 

EXP  47 
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Table  14B. _ Three-Factor  Interaction  Deaign  Matrix 
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Table  15B.  Pour -Factor  Interaction  Oesien  Matrix 
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EXP  45  +  -  -  -  -  -  32  EXP  45 


Table  16B.  Five-Factor  eind  Six-Factor  Interaction  Design  Matrices 
Test  Test 

Condition  AFCIG  AFCIS  AFCGS  AFIGS  ACIGS  FCIGS  Condition  AFCIGS 


I++I  +  1  I++I  t  +  }+  +l  + 


l  +  )+  +l  }  ^+^  +  !  1  + 


2^»nocoi\}tft^^ca»nococo<o-^^^^ococsJino^wioococv3<o^ 
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EXP  44  +  +  +  +  +  +  64  EXP  44 


Appendix  E-  Results  and  Calculations  for  the  Number  of  Recfuired 
Repl i cat  ions 


Table  17.  Calculation  of  Number  of  Runa  Required  -  One  Percent  Accuracy 


NUMBER  OF 
CUMULATIVE 

RUNS 

TONS 

ON  TIME 

NUMBER  OF 

RUNS 

REQUIRED 

TONS 

DELIVERED 

NUMBER  OF 

RUNS 

REQUIRED 

TOTAL 

FUGHT 

HOURS 

NUMBER  OF  i 
RUNS  ! 

REQUIRED  i 

2 

MEAN 

2141  00 

5833.09 

4035  00 

a 

STDS 

24  04 

20  1.46 

104  65 

523  67 

19  80 

38,60  1 

3 

MEAN 

2152.33 

5796.33 

4047.67 

I 

3 

STDS 

25  97 

26  96 

97  52 

52.15 

26.03 

765 

4 

MEAN 

2152  25 

5797  50 

4045  75 

4 

STDS 

21.20 

9.83 

79.66 

19.03 

21.59 

2.88  I 

5 

MEAN 

2155.20 

5795.00 

4035  20 

5 

STDS 

19  51 

6  33 

69.21 

10  93 

30  10 

4.26 

8 

MEAN 

2146  67 

5794  50 

4047  17 

6 

STDS 

27  23 

10  58 

61  92 

7  50 

39  80 

6.39 

7 

MEAN 

2151 86 

5799  57 

4040  29 

7 

STDS 

28  40 

10  43 

58  09 

5  98 

40  64 

6.03 

8 

MEAN 

2152  75 

5810  63 

4042.88 

8 

STDS 

26  41 

8  42 

62  21 

6  41 

38  33 

5  01 

9 

MEAN 

2153  33 

3808.78 

4047  33 

9 

STDS 

24  77 

7  04 

58.45 

5  38 

38  27 

4.75  i 

10 

MEAN 

2152  20 

5810.70 

4049.20 

1 

10 

STDS 

23  S3 

6  17 

55  45 

4  66 

36.56 

4.17  1 

e  -  IX 

21  522 

58.107 

40  492 

NUMBER  CF 

TOTAL 

NUMBER  OF 

PRODUCTIVE 

NUMBER  OF 

PRODUCTIVE 

NUMBER  OF  | 

:UMULATIVE 

SORTIES 

RUNS 

FLIGHT 

RUNS 

SORTIES 

RUNS  I 

RUNS 

REQUIRED 

HOURS 

REQUIRED 

REQUIRED  ' 

a 

MEAN 

7292  50 

463  50 

855  00 

a 

STDS 

2  12 

0  14 

4  95 

185  95 

14  14 

443.14 

3 

MEAN 

7337  00 

458  00 

847  00 

3 

STDS 

77  09 

20  62 

10  15 

89  66 

17  09 

74  20 

4 

MEAN 

7329  00 

457  00 

647  00 

4 

STDS 

64  95 

8  00 

8  52 

34  59 

13  95 

27,05  i 

5 

MEAN 

7308  40 

469.00 

B:>0  20 

5 

STDS 

72  70 

7  63 

8  63 

26  99 

14  04 

20,86 

6 

MEAN 

7328  83 

457  33 

847  67 

6 

STDS 

82  06 

8  34 

8  73 

23  70 

14  01 

17  80 

7 

MEAN 

7308  14 

458  00 

848  14 

7 

STDS 

92  78 

9  66 

8  16 

18  77 

12.85 

13  57  1 

8 

MEAN 

7305  75 

459  75 

851.13 

1 

1 

8 

STDS 

86  16 

7  78 

9  04 

21,47 

14  58 

16  33 

9 

MEAN 

7304  00 

460  56 

852  67 

9 

STDS 

80  77 

6  50 

8.79 

19  32 

14.40 

15,14  ! 

10 

MEAN 

7304  80 

461  20 

853  60 

10 

STDS 

76  19 

5  57 

8  53 

17  52 

13.90 

13  56  1 

e  -  1% 
a  -(1-0  95) 

73  048 

4612 

n  - 

2 

3 

4 

5 

l(a/2.  n-D- 

12  706 

4  303 

3  182 

2  776 

6 

7 

8 

9 

10 

2  571 

2  447 

2  365 

2  306 

2  262 
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Table  18.  Calculation  of  Number  of  Runs  Reoulred  -  Two  Percent  Accurac 


TONS 

NUMBER  OF 

TONS 

TOTAL 

CUMULATIVE 

ON  TIME 

RUNS 

DELIVERED 

RUNS 

FLIGHT 

RUNS 

RUNS 

REQUIRED 

REQUIRED 

HOURS 

REQUIRED 

2 

2141.00 

5833.00 

4035.00 

2 

STDS 

24.04 

50.36 

104.65 

130.92 

19.80 

9.65 

3 

MEAN 

2152.33 

5796.33 

4047.67 

3 

STDS 

25.97 

6.74 

97.52 

13.04 

26.03 

1.91 

4 

MEAN 

2152.25 

5797.50 

4045.75 

4 

STDS 

21.20 

2.46 

79.66 

4.76 

21.59 

0.72 

5 

MEAN 

2155.20 

5795.00 

4035  20 

5 

STDS 

19.51 

1.58 

69.21 

2.73 

30.10 

1.06 

6 

MEAN 

2146.67 

5794.50 

4047.17 

6 

STDS 

27.23 

2.65 

61.92 

1.88 

39.80 

1.60 

MEAN 

2151.86 

5799  57 

4040.29 

STDS 

28.40 

2.61 

58.09 

1.50 

40.64 

1.51 

MEAN 

2152.75 

5810.63 

4042.88 

STDS 

26.41 

2.11 

62  21 

1.60 

38.33 

1.25 

MEAN 

2153.33 

5808.78 

4047.33 

STDS 

24.77 

1.76 

58.45 

1.35 

38.27 

1.19 

10 

MEAN 

2152.20 

5810.70 

4049.20 

10 

23  63 

1.54 

55.45 

1.16 

36.56 

1.04 

e  -  2X 

43.044 

116.214 

80  984 

M‘tTTTT-M 

NUMBER  OF 

RUNS 

RUNS 

im 

REQUIRED 

REQUIRED 

2 

MEAN 

7292.50 

463.50 

855.00 

2 

STDS 

2.12 

4.95 

46.49 

14.14 

110.78 

3 

MEAN 

7337.00 

458.00 

847.00 

3 

STDS 

77.09 

5.16 

10.15 

22  42 

17.09 

18.55 

4 

MEAN 

7329.00 

847.00 

4 

STDS 

64.95 

2.00 

8  52 

8.65 

13.95 

6  76 

5 

MEAN 

7308.40 

459  00 

850.20 

5 

STDS 

72.70 

1.91 

8  83 

6.75 

14.04 

5  21 

6 

MEAN 

7328.83 

457  33 

847.67 

6 

STDS 

82.06 

2  09 

8.73 

5  93 

14.01 

4  45 

7 

MEAN 

7308  14 

458  00 

848.14 

7 

STDS 

92.78 

2.41 

8.16 

4.69 

12.85 

3.39 

8 

MEAN 

7305.75 

459  75 

851.13 

8 

STDS 

86  16 

1  95 

9.04 

5  37 

14  58 

4.08 

9 

MEAN 

7304.00 

460.56 

852.67 

9 

STDS 

80.77 

8  79 

4.63 

14.40 

3.79 

10 

MEAN 

7304.80 

461  20 

853.60 

10 

STDS 

76  19 

8.53 

4.38 

13.90 

3  39 

e  ~  2%  146.096 

a  m-0  95) 

n  -  2  3 

t(a/2.  n-D-  12.706  4  303 

6  7  8 

2  571  2  447  2.365 


9  224  17.072 

4  5 

3.182  2.776 

9  10 

2  308  2  262 
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e  •  3%  319  144 

a  >(1-0  95) 
n  -  2 

t(a/2,  n-l)>  12  706 

6  7 

2.571  2.447 
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Table  20.  Calculation  of  Number  at  Rune  Reoulred  -  Four  Percent  Accurac 


2141.00 

1 

1 

5833.00 

24.04  1 

(  12.59 

104.65 

2152.33 

5796.33 

25.97  1 

1.68 

97.52 

2152.25 

5797.50 

NUMBER  OF 

TOTAL 

NUMBER  OF 

RUNS 

FLIGHT 

RUNS 

REQUIRED 

HOURS 

REQUIRED 

403S.00 


4047.67 


4045.75 


4035.20 


4047  17 


4040.29 


4042.88 


4047  33 


4049.20 


86  088 


232.428 


161.968 


REQUIRED 


11.62 

5.60 


7329  00 


7308  40 


7328.83 


82 


7308.14 
8 

7305.75 


6 

7304.00 


8 


7304  80 


8. 


459  75 


460.56 


6-41:  292  192 

a  -  (1  -0  95) 
n  »  2 

t(a/2.  n-D-  12  706 

6  7 

2  571  2  447 


18  448 
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Appendix  F:  Elandon  Number  Seeds  Used  For  Experimental  Runs 


Randan  Number  Seeds 


Run 

Number 

PK 

OTOER 

EXP 

00 

2006429302 

600743814 

EXP 

01 

2016429302 

601743814 

EXP 

02 

2026429302 

602743814 

EXP 

03 

2036429302 

603743814 

EXP 

04 

2046429302 

604743814 

EXP 

05 

2056429302 

605743814 

EXP 

06 

2066429302 

606743814 

EXP 

07 

2076429302 

607743814 

EXP 

08 

2086429302 

608743814 

EXP 

09 

2096429302 

609743814 

EXP 

10 

2106429302 

610743814 

EXP 

11 

2116429302 

611743814 

EXP 

12 

2126429302 

612743814 

EXP 

13 

2136429302 

613743814 

EXP 

14 

.  2146429302 

614743814 

EXP 

15 

2115429302 

615743814 

EXP 

16 

2016429302 

616743814 

EXP 

17 

2017429302 

617743814 

EXP 

18 

2018429302 

618743814 

EXP 

19 

2019429302 

619743814 

EXP 

20 

2020429302 

620743814 

EXP 

21 

2021429302 

621743814 

EXP 

22 

2022429302 

622743814 

EXP 

23 

2023429302 

623743814 

EXP 

24 

2024429302 

624743814 

EXP 

25 

2025429302 

625743814 

EXP 

26 

2026429302 

626743814 

EXP 

27 

2027429302 

627743814 

EXP 

28 

2028429302 

628743814 

EXP 

29 

2029429302 

629743814 

EXP 

30 

2030429302 

630743814 

EXP 

31 

2031429302 

631743814 

Random  Number  Seeds 

Run 


Number 

PK 

OTOER 

EXP 

32 

2032429302 

632743814 

EXP 

33 

2033429302 

633743814 

EXP 

34 

2034429302 

634743814 

EXP 

35 

2035429302 

635743814 

EXP 

36 

2036429302 

636743814 

EXP 

37 

2037429302 

637743814 

EXP 

38 

2038429302 

638743814 

EXP 

39 

2039429302 

639743814 

EXP 

40 

2040429302 

640743814 

EXP 

41 

2041429302 

641743814 

EXP 

42 

2042429302 

642743814 

EXP 

43 

2043429302 

643743814 

EXP 

44 

2044429302 

644743814 

EXP 

45 

2045429302 

645743814 

EXP 

46 

2046429302 

646743814 

EXP 

47 

2047429302 

647743814 

EXP 

48 

2048429302 

648743814 

EXP 

49 

2049429302 

649743814 

EXP 

50 

2050429302 

650743814 

EXP 

51 

2051429302 

651743814 

EXP 

52 

2052429302 

652743814 

EXP 

53 

2053429302 

653743814 

EXP 

54 

2054429302 

654743814 

EXP 

55 

2055429302 

655743814 

EXP 

56 

2056429302 

656743814 

EXP 

57 

2057429302 

657743814 

EXP 

58 

2058429302 

658743814 

EXP 

59 

2059429302 

659743814 

EXP 

60 

2060429302 

660743814 

EXP 

61 

2061429302 

661743814 

EXP 

62 

2062429302 

662743814 

EXP 

63 

2063429302 

663743814 
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Table  2  1  A.  Yate'a  algorithm.  Regulta  lor  Ratio  On  Time 


Appendix  G:  Yate's  Algorithm  -  Calculations  for  Estimate  of  Effect 
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Table  2 IB.  Yate'3  aljorithin.  Results  tor  Ratio  On  Time 
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Table  23A  Yate'i  ntorUhm.  ReaulU  tor  Ratio  Delivered 
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Tnbte  32B.  Ynte's  nliiorithin.  Results  tor  Rntto  Delivered 
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Table  2  4  A.  Yale's  aUtorilbm.  Results  for  Total  Sorties  Flow 
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3143  5806  450  -1099  2041  374  2050  32 _ 64  063  AFCIG 


Table  24B.  Yate'i  nlaoriihm.  Re»utti  for  Total  Sorties  Flown 
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Table  25A.  Yate'g  alitorithm.  Results  tor  Productive  Flight  Hours 
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Appendix  H:  Difference  Between  Two  Averages  -  Calculations  for 
Estimate  of  Effect  and  Standard  Error 


Table  27,  Summary  of  Estimated  Effects  of  Conditions 
on  the  Ratio  of  Cargo  Delivered 


RATIO 

RATIO 

RATIO 

RATIO 

ON  TIME 

DELIVERED 

ON  TIME 

DELIVERED 

Average: 

Main  Effects: 

0.239219 

0.567813 

A 

0.020313 

0.019375 

F 

0.006562 

0.016250 

Two  Factor 

Interaction 

Effects; 

C 

0.155938 

0.338750 

AF 

0.003438 

0.006250 

I 

-0  001562 

-0.001875 

AC 

0.015313 

0.002500 

G 

0 148437 

0.334375 

A1 

-0.002188 

-0.000625 

S 

0.015312 

0.024375 

AG 

0.007812 

0  005625 

AS 

-0.001563 

-0.000625 

Four  Factor 

Interaction 

Effects: 

FC 

0.002813 

-0.005625 

AFCI 

-0.000313 

0.000625 

FI 

0.000313 

0.002500 

AFCG 

0.002187 

0.003125 

FG 

0.0U6562 

0.017500 

AFCS 

0.001562 

0.000625 

FS 

0.002187 

0.002500 

AFIG 

-0.000313 

0.000000 

Cl 

0.002188 

-0.003750 

AFIS 

0.000312 

-0.000000 

CG 

0.065938 

0.057500 

AFGS 

0.000312 

0.002500 

cs 

0.007812 

-0.003750 

ACIG 

0.001562 

-0.000000 

IG 

0.000937 

0  008125 

ACIS 

0.000937 

0.003750 

IS 

-0  000938 

-0.005625 

ACGS 

0.000937 

0.000000 

GS 

0.010312 

0.013125 

AIGS 

-0.000313 

-0.003125 

FCIG 

0.000313 

-0.004375 

Three  Factor  Interaction  Effects; 

FCIS 

-0  000313 

0.000625 

AFC 

0.002187 

0.004375 

FCGS 

0.000937 

-0.001875 

AFI 

-0.000313 

0.000000 

FIGS 

-0.000313 

0.001250 

AFG 

0.003437 

0.005000 

CIGS 

0.002812 

0.006250 

AFS 

0.000312 

0.001250 

ACI 

0.001562 

0.000000 

Five  Factor 

Interaction 

Effects: 

ACG 

0  002812 

-0  011250 

AFCIG 

-0.000313 

0  000625 

ACS 

-0  001562 

-0.001250 

AFCIS 

0.000312 

-0  000625 

AIG 

-0.002168 

-0.000625 

AFCGS 

0.001562 

0.001875 

AIS 

-0.000313 

-0.000625 

AFIGS 

0.000312 

0.000000 

AGS 

0  000937 

0.000625 

ACIGS 

0.000937 

0.001250 

FCI 

0.000313 

-0.004375 

FCIGS 

-0.000313 

0.000625 

FCG 

0.002812 

-0.004375 

FCS 

0.000937 

-0.000625 

Six  Factor  Interaction  Effect: 

FIG 

0.000312 

0.002500 

AFCGIS 

0.000312 

-0.000625 

FIS 

-0  000313 

0.001250 

FGS 

0.002187 

0  001250 

Calculation  of  Standard  Error  for  Effects 

CIG 

0  004687 

0  006250 

using  3.  4.  5  and  6 

factor  interactions: 

CIS 

0  000312 

-0.001250 

CGS 

0.002812 

-0.015000 

Sum  of  squares: 

0.000106 

0  000603 

IGS 

0.001562 

0.001875 

Variance: 

0.000003 

0.000014 

Est  of  Std  Dev: 

0.001592 

0.003789 
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Table  28.  Summary  at  E«timatfld  Effecta  of  Condtttona 
on  the  Number  of  Houn  Flown 


TOTAL 

PRODUCTIVE 

TOTAL  PRODUCTIVE 

FUGHT 

FUGHT 

FUGHT 

FUGHT 

HOURS 

HOURS 

HOURS 

HOURS 

Average: 

Main  Effecta: 

1576.766 

295.719 

A 

403.031 

36.563 

F 

-30.969 

-4.063 

Two  Factor 

Interaction  Effecta: 

C 

-1039  781 

152  938 

AF 

-22.844 

4  063 

I 

-1118.156 

-186.750 

AC 

-211.156 

8.563 

G 

1144.719 

199.125 

AI 

-236.656 

-10.500 

S 

182.281 

10.250 

AG 

153.844 

-4.000 

AS 

-23.969 

-1  250 

Four  Factor 

Interaction  Effecta: 

FC 

17.094 

-3.313 

APa 

-8.219 

0,375 

FI 

-10.281 

4.375 

AFCG 

20.656 

1.750 

FG 

-8.906 

-5,000 

AFCS 

21.344 

0.500 

FS 

-13.219 

0  250 

AFIG 

-11.969 

-2,063 

Cl 

533.781 

-18.000 

AFIS 

-4.531 

0.438 

CG 

-960.469 

-68.500 

AFGS 

-€.656 

2.188 

CS 

-161,781 

-5.500 

ACIG 

142.344 

8.313 

IG 

-559.719 

-110.313 

ACIS 

19.781 

4.313 

IS 

-85.781 

-4.063 

ACGS 

3.531 

-0.063 

GS 

97.969 

0.313 

AIGS 

-31.469 

-3.375 

Fao 

26.469 

-4.688 

Three  Factor  Interaction 

Effecta: 

FCIS 

-14.094 

0.313 

AFC 

43.594 

2  813 

FCGS 

-1.969 

-0.438 

AFI 

-2  156 

-2.125 

FIGS 

-1 1 844 

1.500 

AFG 

-8.656 

3  125 

aGS 

84.719 

8.625 

AFS 

-11.094 

-0.250 

Aa 

197.406 

7.250' 

Five  Factor 

Interaction  Effecta: 

ACG 

-224  969 

-27  625 

AFCIG 

14.594 

0  313 

ACS 

0  844 

-2.000 

AFas 

-5  344 

-1.313 

AIG 

-139.844 

-7.313 

AFCGS 

5.906 

1.813 

AIS 

-4.531 

1  563 

AFICS 

-7  594 

-0  375 

AGS 

5.094 

1.813 

AaGS 

26.219 

0  750 

Fa 

2  281 

-4.625 

FUGS 

18.344 

0.125 

FCG 

-3.219 

-2.875 

FCS 

21.594 

-1,500 

Six  Factor  Interaction  Effect: 

FIG 

-25  969 

5  438 

AFCGIS 

15.469 

-1.250 

FIS 

-1.156 

0  563 

FGS 

-2.656 

-0.063 

Calculation  of  Standard 

Error  for  Effecta 

ac 

371  594 

-1  688 

uaing  3.  4.  5  and  6  factor  interactiona: 

as 

81.156 

3  688 

CGS 

-128.719 

-15.063 

Sum  of  squarea 

311338.518 

1395.336 

IGS 

-70.844 

0  500 

Variance: 

7412  822 

33.222 

Eat  of  Std  Dev: 

86.098 

5  764 
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Table  39.  Summary  at  Eatlroatad  Effecta  of  Condltlong 
on  the  Number  of  Sortlea  Flown 


TOTAL 

PRODUCTIVE 

TOTAL  PRODUCTIVE 

SORTIES 

SORTIES 

SORTIES 

aiRTIES 

Average: 

Main  Effects: 

4039.90B 

758.828 

A 

956.125 

69.094 

F 

-138.875 

-9.719 

Two  Factor  Interaction  Eftecta; 

C 

-2453.875 

340.531 

AF 

-68.188 

7  594 

I 

-316.938 

10.094 

AC 

-583.188 

8.094 

G 

2333.250 

366.844 

AI 

-310.125 

-3.594 

S 

424.688 

30.281 

AG 

356.688 

5.531 

AS 

-67  125 

-2  781 

Pour  Factor 

Interaction  Effects: 

FC 

68.313 

-17.969 

AFa 

15.375 

2.406 

FI 

-47.500 

7.719 

AFCG 

62.563 

2.531 

FG 

-61.813 

-10.281 

APCS 

54.875 

1.344 

FS 

-56.000 

1.781 

AFIG 

-41.875 

-3.156 

a 

598.500 

77.344 

APIS 

-19.688 

1.531 

CG 

-2001.938 

-141.656 

AFGS 

-28.750 

3.656 

cs 

-390.000 

-13.719 

AQG 

211  250 

-1.656 

IG 

-489.250 

-111.219 

ACIS 

45.313 

8.656 

IS 

-72.688 

-7  656 

ACGS 

20.875 

-1  219 

GS 

162.125 

3.344 

AIGS 

-94.688 

-8.281 

FOG 

78.375 

-18.344 

Three  Factor 

Interaction 

Effecta: 

PCIS 

-34.188 

-0.406 

AFC 

108.875 

5.219 

FCGS 

2.750 

0.094 

AFI 

-26.563 

-2.344 

FIGS 

-47  438 

3  156 

AFG 

-36.000 

5.031 

aGS 

115.438 

13.156 

AFS 

-33.188 

1.594 

ACT 

345  438 

15.781 

Five  Factor 

Interaction  Effects: 

ACG 

-537  375 

-46.844 

AFHG 

64.063 

1.969 

ACS 

6.813 

-2.656 

AFCIS 

8.000 

-3.844 

AIG 

-234  063 

-11.656 

AFCGS 

28.813 

0.781 

AIS 

-25  250 

1906 

AFIGS 

-20.500 

1  844 

AGS 

-6  813 

1  531 

AaGS 

81.125 

2  594 

pa 

9  813 

-16.406 

FOGS 

59.625 

-2.219 

FCG 

10.125 

-14  656 

FCS 

60  938 

-2.844 

Six  Factor  Interaction  Effect: 

FIG 

-94.188 

8  906 

AFCGIS 

51  188 

-1  656 

FIS 

-5  000 

1.344 

FGS 

-17  938 

1.344 

Calculation  of  Standard 

Error  for  Effecta 

aG 

301.188 

-61 844 

using  3.  4.  5  and  6  factor  Interactions: 

CIS 

58.500 

2.969 

CGS 

-238.563 

-36  531 

Sum  of  squares 

758357.117 

9143.674 

IGS 

-91  250 

1.906 

Variance: 

18056.122 

217.707 

Est  of  Std  Dev: 

134.373. 

14.755 
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Table  30A  Ynte'a  algorithm.  Results  lor  Ratio  On  Time  -  Transtormed  to  Naturnl  Logarithms 


Appendix  I:  Yate's  Algorithm  -  Calculations  for  Estimate 
of  Effect  for  Transformed  Results 
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Tebte  30B.  Yate's  aUprithm.  Results  for  Ratio  Op  Time  -  Transformed  to  Natural  Loaarithcnt 
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Table  32A  Yale's  algorithm.  Resulta  for  Total  Flight  Hours  -  Tranatormed  To  Natural  Logttritbmi 
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Table  34 A _ Yate'g  algorithm.  Results  tor  Productive  Flight  Hours  -  Trapstormed  to  Natural  Logarithms 
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Table  35A  Yale's  algorithm.  Results  for  Productive  Sorties  Flown  -  Transformed  to  Natural  Logarithms 
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Table  3&B.  Yate'a  algorithm,  Reaults  tor  Productive  Sortieg  Flown  -  Tranalormed  to  Natural  Logarithms 
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jpendix  J: 


Difference  Between  ivio  Averages  -  Calculations  for  Estimate 
of  Effect  and  Standard  Error  for  Transformed  Results 


Table  36.  Summary  of  Estimated  Effects  ot  Conditions 
on  the  Ratio  of  Cargo  Delivered  - 
Results  Transformed  to  Natural  Logarithms 


RATIO 

RATIO 

RATIO 

RATIO 

ON  TIME 

DELIVERED 

ON  TIME 

DELIVERED 

Average: 

Main  Effects: 

-1.535428 

-0.664018 

A 

0.069347 

0.032740 

F 

0.019679 

0.025351 

Two  Factor  Interaction 

Effects: 

C 

0.647986 

0.643881 

AF 

0.008980 

0  007268 

I 

-0.011130 

-0.005024 

AC 

0.045037 

0.001407 

G 

0.612359 

0.633737 

AI 

-0.009631 

-0.000609 

S 

0.052023 

0.041477 

AG 

0.009410 

0  007187 

AS 

-0.009184 

-0.002047 

Four  Factor 

Interaction 

Effects: 

FC 

0.001497 

-0  015130 

AFCI 

-0.001066 

0.0011 12 

FI 

0.000950 

0.005321 

AFCG 

0.002996 

0.002633 

FG 

0.019679 

0  027778 

AFCS 

0  005059 

-0.000070 

FS 

0.005985 

0.003353 

AFIG 

-0.000638 

-0.000456 

Cl 

0  006768 

-0.008462 

AFIS 

0.000829 

0  000417 

CG 

0.090673 

-C  088493 

AFGS 

-0.001467 

0.003331 

CS 

0  015203 

-0.010836 

ACIC 

0.007724 

-0.000102 

IG 

0.000525 

0.013172 

ACIS 

0,003635 

0.006757 

IS 

-0.006498 

-0.010601 

ACGS 

0.005206 

0.001238 

GS 

0.027544 

0.020854 

AIGS 

-0.002295 

-0.006087 

FCIG 

0.000522 

-0  007413 

Three  Factor  Interaction  Effects: 

FCIS 

-0.000945 

0.000615 

AFC 

0.002996 

0.005060 

FCGS 

0  000314 

-0.002840 

AFI 

-0  000638 

-0  000456 

FIGS 

-0.000830 

0.001407 

AFG 

0.008980 

0.004841 

CIGS 

0.010545 

0.01 1  198 

AFS 

-0.001467 

0  000903 

ACI 

0.008267 

0.000229 

Five  Factor 

Interaction 

Effects: 

ACG 

-0  014899 

-0  024146 

AFCIG 

-0  001066 

0.001112 

ACS 

-0.008159 

-0.001521 

AFCIS 

0  000714 

-0.001 142 

AIG 

-0  010174 

-0.000940 

AFCGS 

0  005059 

0.002357 

AIS 

-0.001753 

-0.001  168 

AFIGS 

0  000829 

0.000417 

AGS 

0  004182 

0  00071  1 

ACIGS 

0.003093 

0.001839 

FCI 

0  000522 

-0  007413 

FCIGS 

-0.000945 

0.000615 

FCG 

0  001497 

-0.012702 

FCS 

0.000314 

-0.000413 

Six  Factor  Interaction  Effect: 

FIG 

0  000950 

0.005321 

AFCGIS 

0.000714 

-0.001  142 

FIS 

-0.000830 

0  001407 

FGS 

0  005985 

0  000926 

Calculation  of  Standard 

Error  for  Effects 

CIG 

0  018423 

0  009734 

using  3.  4.  5  and  6  factor  interactions: 

CIS 

-0  001  1  1  1 

-0.002410 

CGS 

-0  009276 

-0  031459 

Sum  of  squares: 

0  001363 

0  002293 

IGS 

0  005157 

0  003007 

Variance: 

0  000032 

0  000055 

Est  of  Sid  Dev: 

0  005696 

0  007389 
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Table  37  Summary  of  Estimated  Effects  of  Conditions 
on  the  Number  of  Hours  Flowa  - 
Results  Transformed  to  Natural  Logarithms 


FLIGHT 

FLIGHT 

FLIGHT 

FLIGHT 

HOURS 

HOURS 

HOURS 

HOURS 

Average: 

Main  Effects: 

7  163 

5  469 

A 

0  214 

0.1 15 

F 

-0.022 

-0.003 

Two  Factor 

Interaction  Effects: 

C 

-0.501 

0.778 

AF 

-0.006 

0  009 

I 

-0.871 

-0.657 

AC 

-0.022 

0  029 

G 

0.807 

0.851 

AI 

-0  045 

-0.010 

S 

0  087 

0.034 

AG 

-0.025 

-0.033 

AS 

-0.031 

-0  009 

Four  Factor 

Interaction 

Effects: 

FC 

0.005 

-0.017 

AFCI 

-0.001 

0.006 

FI 

-0  008 

0.009 

AFCG 

0.009 

0.004 

FG 

-0.006 

-0.010 

AFCS 

0.010 

0.002 

FS 

-0.006 

0.005 

AFIG 

-0.006 

-0.004 

Cl 

0.112 

0.124 

AFIS 

-0  003 

0.004 

CG 

-0  462 

-0  547 

AFGS 

-0.002 

0.009 

CS 

-0.062 

-0.012 

ACIG 

0.008 

-0.007 

IG 

-0.106 

-0.138 

ACIS 

0.003 

0.010 

IS 

-0,003 

-0.004 

ACGS 

0.012 

0.004 

GS 

-0.004 

-0.001 

AIGS 

-0.015 

-0.013 

FCIG 

0.012 

-0.020 

Three  Factor  Interaction 

Effects: 

FCIS 

-0.012 

0  001 

AFC 

0.025 

0  009 

FCGS 

-0  003 

0.001 

AFI 

-0.002 

-0.004 

FIGS 

-0.008 

0.005 

AFG 

0  003 

0  007 

CIGS 

0  020 

0  014 

AFS 

-0.003 

-0  003 

ACI 

0.054 

0.028 

Five  Factor 

Interaction 

Effects: 

ACG 

-0  061 

-0.080 

AFCIG 

0.013 

0.004 

ACS 

0  007 

-0.001 

AFCIS 

-0  003 

-0.004 

AIG 

-0  013 

-0.008 

AFCGS 

0  003 

0  002 

AIS 

0.007 

0  008 

AFIGS 

-0.003 

-0.000 

AGS 

0.002 

0  005 

ACIGS 

0.010 

0.002 

FCI 

-0  004 

-0.017 

FCIGS 

0.013 

-0.002 

FCG 

-•0,007 

-0.01 1 

FCS 

0  010 

-0  007 

Six  Factor  Interaction  Effect: 

FIG 

-0  016 

0.015 

AFCGIS 

0  011 

-0.001 

FIS 

-0  001 

-0  000 

FGS 

-0.001 

-0  001 

Calculation  of  Standard 

Error  for  Effects 

CIG 

-0.035 

-0  089 

using  3.  4.  5  and  6  factor  Interactions: 

CIS 

0  000 

-0  002 

CGS 

-0  027 

-0.039 

Sum  of  squares: 

0.012109 

0  018697 

IGS 

-0.012 

0  005 

Variance: 

0  000288 

0  000445 

Esl  of  Std  Dev: 

0.016979 

0.021099 
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Table  38.  Summary  of  Estimated  Effects  of  Conditions 
on  the  Number  of  Sorties  Flown  - 
Results  Transformed  to  Natural  Logarithms 


TOTAL 

PRODUCTIVE 

TOTAL 

PRODUCTIVE 

SORTIES 

SORTIES 

SORTIES 

SORTIES 

Average; 

Main  Effects; 

8.197 

6  544 

A 

0  205 

0.085 

F 

-0.031 

-0  006 

Two  Factor 

Interaction 

Effects; 

C 

-0.528 

0.547 

AF 

-0.006 

0.008 

I 

-0.009 

0.013 

AC 

-0.048 

0.005 

G 

0  493 

0.589 

AI 

-0.044 

-0.01 1 

S 

0  084 

0  041 

AG 

-0.006 

-0.000 

AS 

-0.031 

-0  008 

Four  Factor 

Interaction 

Effects: 

FC 

0.007 

-0.021 

AFCI 

-0.001 

0.004 

FI 

-0.007 

0.009 

AFCG 

0.008 

0.002 

FG 

-0  008 

-0  010 

AFCS 

0.010 

0  002 

FS 

-0  010 

0.004 

AFIG 

-0.005 

-0  004 

Cl 

0.114 

0  107 

AFIS 

-0.003 

0.003 

CG 

-0  365 

-0  330 

AFGS 

-0  003 

0  005 

CS 

-0.067 

-0.015 

ACIG 

0.013 

-0  002 

IG 

-0.082 

-0.122 

ACIS 

0.002 

0.009 

IS 

-0.005 

-0.011 

ACGS 

O.OlO 

0.002 

GS 

-0.008 

0.001 

AIGS 

-0  019 

-0.013 

FCIG 

0  014 

-0  023 

Three  Factor  Interaction  Effects: 

FCIS 

-0.015 

0.002 

AFC 

0  022 

0  006 

FCGS 

-0.006 

0  001 

AFI 

-0  003 

-0.003 

FIGS 

-0  010 

0.004 

AFG 

0.001 

0.005 

CIGS 

0  019 

0  017 

AFS 

-0.002 

0  001 

ACI 

0  046 

0  015 

Five  Factor 

Interaction 

Effects 

ACG 

-0  068 

-0  055 

AFCIG 

0.013 

0  004 

ACS 

0  008 

-0  001 

AFCIS 

-0  001 

-0  005 

AIG 

-0.012 

-0  001 

AFCGS 

0.003 

-0  001 

AIS 

0  009 

0.005 

AFIGS 

-0  001 

0.002 

AGS 

0  000 

0.003 

ACIGS 

0.01 1 

0  003 

FCI 

-0  005 

-0  018 

FCIGS 

0.015 

-0  004 

FCG 

-0  009 

-0  014 

FCS 

0  012 

-0  005 

Six  Factor  Interaction  Effect: 

FIG 

-0  019 

0  013 

AFCGIS 

0  011 

-0.001 

FIS 

0  001 

-0.001 

FGS 

-0  000 

-0  000 

Calculation  of  Standard 

Error  for  Effects 

CIG 

0  008 

-0  080 

using  3.  4.  5  and  6  factor  interactions: 

CIS 

-0.004 

-0.003 

CGS 

-0  023 

-0.042 

Sum  of  squares: 

0  011 187 

0  013558 

IGS 

-0  007 

0  006 

Variance: 

0  000266 

0  000323 

Est  of  Std  Dev 

0  016321 

0  017967 
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Table  39A  Experimental  Results  Transformed  to  Natural  Logarithma ; 

GAMM  Central  American  Scenario 

Teat  Total  Productive 

Condition  Ratio  Ratio  Plight  Total  Plight  Productive 

Number  Run  No  On  Time  Delivered  Hours  Sorties  Hours  Sorties 


Appendix  K:  Experimental  Results  Transformed  to  Natural  Logarithms 
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EXP  60  0798506  -0072571  8  890842  8,081171  5  655992  6942157 

EXP  12  -0  843970  0  061875  8'532334  7  912423  5  564520  6  837333 

EXP  44  -0  713350  -0  020203  6  683361  8  031060  5  641907  6  898715 


Appendix  L:  Analysis  of  Initial  Regression  Equations 


Explanation  of  Analysis 

For  each  regression  equation,  64  estimates  were  calculated  with 
each  variable  being  s\±)stituted  by  either  +1  or  -1,  according  to  the 
value  of  that  variable  in  the  design  matrix.  Then,  using  all  64 
results,  the  sum  of  the  squares  about  the  mean,  the  sum  of  the  squares 
due  to  the  regression,  and  the  sum  of  the  squares  of  the  residuals  were 
calculated. 

In  the  ANOVA  table,  for  each  individual  measure  of  effectiveness, 
the  Total  Sum  of  Squares,  which  is  also  the  sum  of  the  squares  about  the 
mean,  has  the  same  value.  The  exception  to  this  is  Ratio  On  Time,  where 
there  is  one  Total  Sum  of  Squares  value  for  the  untransformed  results, 
and  one  for  the  transformed  results. 

The  calculations  for  each  ANOVA  table  were  carried  out  on  a 
spreadsheet,  and,  as  a  result  of  round  off  error,  the  sum  of  the  values 
for  the  Sum  of  Squares  of  the  Regression  and  the  Sum  of  Squares  of  the 
Error  do  not  exactly  equal  the  Total  Sum  of  Squares.  The  values  are 
accurate  to  the  fourth  significant  figure,  or  better. 
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Ratio  On  Time  Function  -  Equation  1 
y=0  2392  1 9+(0. 0203  13/2 )A+(0. 006562/2 )F+(0. 155938/2)0 
+(0,148437/2)G+(0.0  153  12/2)S+(0.065938/2)CG+(0.0  153  13/2  )AC 
+(0.0078  12/2)AG+(0.007812/2)CS+(0.0  103  12/2  )GS 
_  ANOVA  TABLE 


Source  of 

Variation 

DF 

Sum  of 
Squares 

Mean  j  F  j 

Square  !  i 

Regression 

10 

0.82962 

0.08296  1443.848  j 

Error 

53 

0.00305 

0.00006 

.Total 

83 

0.83266 

1 

'r^2  0,996343 

_ 1 

Adjusted  R'^J 

0.995653 

Ratio  On  Time  -  Plot  of  Residuals 


Estimated  Results  •  Equation  1 


Ratio  On  Time  •  Normal  Probability  Plot 


Residual  Values  •  Equation  1 
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Ratio  On  Time  Function  -  Equation  2 
Ln(y)=- 1. 535  428  ^(0, 069347/2  )A+(0.01 9679 /2)F+(0. 6  47986/2)0 
^(0.6  1 2359/2  )G^(0. 052023/2  )S+(0. 090673/2  )CG4-(0.045037/2)AC 
-(0  0  19679/2)FG^(0.0275  44/2)GS+(0.018423)CIG 


ANQVA  TABLE 


^Source  of 
,  Variation 

DF 

Sum  of  1 
Squares  | 

Mean 

Square 

F  1 

[Regression 

10 

i  13.03193  1 

1.30319 

2331.128  j 

(Error 

1  53 

0.02963  1 

0.00056 

1 

iTotal 

63 

13.06174  1 

1 _ 1 

|r^2  0.997732 

[Adjusted  R^2 

0.997304  ! 

Ratio  On  Time  -  Plot  of  Ln  Residuals 
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Ratio  Delivered  Function  -  Equation  1 
Ln(y)=-0. 6640  18+(0. 0327  4/2)A+(0. 02535  1/2)F^(0. 6  4338  1/2)C 
+(0. 633737 /2)G+(0. 041 477/2  )S+(0. 027778/2  )FG 
^(-0. 088  493/2  )CG+(-0. 0241 46/2)ACG+(-0.031 459/2  )CGS 


ANQVA  TABLE 

1  niD  i  ^ 


Source  of 
iVariation 

DF  i 

'  Sum  of  ! 

1  : 

Squares 

Mean 

1 

1  Square 

1  p  1 

!  ^  1 

1 

_ 1 

’Regression 

:  9  i 

13,27705  j 

1.47523 

2446.741  ; 

!  Error 

54 

0.03256 

0.00060 

j 

ITotal 

63 

13,30961 

i 

1 

R''2  0.997554 

Adjusted  R^S 

> 

0.997146  i 

C 
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2.5-j - w 


-h 


-0.03  -0.01  0.01  0.03  0.05 

Residual  Values  (Ln)  •  Equation  1 
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Total  Flying  Hours  Function  -  Equation  1 
Ln(y)=7  163+(6.2  14/2)A+(-0,50  l/2)C+(-0.671/2)I+(0,607/2)G 
+(0 .0  8 7 /2  )S+(0 . 1 2  2 /2  )CI+(-0  46 2 /2  )CG 
-(-0 . 1 0  6 /2  )IG+(0 .0  5  4 /2  )ACI 
ANOVA  TABLE 


[Source  of 
[Variation 


Total 


0.997019 


Sum  of 
Squares 


Mean  , 
Square  i 


j  Regression 

1  9 

21.81114 

2.42346 

456.495  i 

[Error 

i  54 

t  0.28668 

0.00531  I 

i 

22  08462 


iAdiusted  R^2 


0.984856 


Total  Fit  Hrs  -  Plot  of  Ln  Residuals 


Estimated  Results  (Ln)  -  Equation  1 


Total  Fit  Hrs  -  Normal  Probability  Plot 


Residual  Values  (Ln)  •  Equation  1 
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Total  Sorties  Flown  Function  -  Equation  1 
Ln(y)-8.197+(.205/2)A+(-,526/2)C+(.493/2)G+(.08- /2)S 

+(.114  /2  )CI+(-.0  82/2  )IG+(-.3  6  5  /2  )CG+(-.0  6  8  /2  )ACG 


ANOVA  TABLE 


- - 1 

Source  of 

Variation 

DF 

Sum  of 
Squares 

Mean 

Square 

F 

Regression 

8 

1  1  62200 

1.45275 

284.49  136 

Error 

55 

0.28086 

0.0051  . 

Total 

63 

1  1.90955 

_ ^ _ 

,R^2  0.976418 

Adjusted  R^< 

> 

0.9729874 

f\  4  C _ 

Total  Sorties  -  Plot  of  Ln  Residuals 
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Productive  Flying  Hours  Function  -  Equation  1 
Ln(y)=5 . 4  6  9  ^(0 . 1  1 5 /2  )A4-(0 .7  7  8 /2  )C-f  (-0 .6  5  7 /2  )I+(0 .8  5  1 /2  )G 
+(0.124/2  )CI^(-0 ,5  47/2  )CG+(-0 . 1 3  6  /2  )IG 
+(-0.080/2)ACG^(-0.089/2)CIG 


ANOVA  TABLl 

E 

Source  of 

'  DF 

1 

Sum  of 

Mean 

F  ! 

j 

1  Variation 

1 

1 

Squares  < 

Square 

1 

j  Regression 

1  9 

33.94818 

3.77202 

1524.693  1 

1  Error 

!  54 

0.13359 

I  0.00247 

iTotal 

63 

!  34.08075  i 

!R^2  0.996080 _ [Adjusted  R^2 _ 0.995427  ! 


Productive  Fit  Hrs-Plot  of  Ln  Residuals 
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Productive  Sorties  Function  -  Equation  1 
Ln(y  )=6 .5  4  4 +(0 .0  8  5  /2 )  A+(0 .547/2  )C+(0 .5  8  9  /2  )G+(0 . 1 0  7  /2  )CG 
+(-0 .122/2  )IG+(-0 .3  3  /2  )CG+(  -0 .0  5  5  /2  )ACG+(-0 .0  8  /2  )CIG 


ANOVA  TABLE 


Source  of 

Variation 

Df 

Sum  of 
Squares 

Mean 

Square 

F 

Regression 

8 

12.76821 

1.59603 

757.536 

Error 

55 

0.1 1588 

0.0021 1 

Total 

63 

12.88112 

R^2  0.99100 

Adjusted 

> 

0.98970 

Productive  Sorties-Plot  of  Ln  Residuals 


0.15 


Estimated  Results  (Ln)  -  Equation  1 


Prod  Sorties  -  Normal  Probability  Plot 
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Ratio  On  Time  Function  -  Equation  3 
y=0. 2392  1 9+(0. 0203  1 3/2  )A+(0.1 55938/2  )C+(0. 148437/2)0 
+(0.01 53  12/2)S+(0 .065938/2  )CG+(0. 01 531 3/2  )AC 

_ ANQVA  TABLE _ _ 

iSource  of  |  DF  i  Sum  of  Mean  F 

i  Variation _ i _ !  Squares _ Square _ 

i  Regression  ^  6  !  0.82527  0.13755  1061.041 

Error _ j  57  ^  0.00739  0.00013 _ 

Total _ !  63  0.83266  _ 

!R^2  0.991  126 _ lAdiusted  R^2 _ 0.990192 


Ratio  On  Time  -  Plot  of  Residuals 


Estimated  Results  -  Equation  3 


Ratio  On  Time  -  Normal  Probability  Plot 


Residual  Values  -  Equation  3 
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Ratio  On  Time  Function  -  Equation  4 
Ln(y)=- 1. 535  428+(0. 069347/2  )A+(0.647986/2)C+(0 .6  12359/2)0 
+(0. 052023/2  )S+(0. 090673/2  )CG+(0.045037/2)AC 
_ ANOVA  TABLE 


Source  of 

Variation 

DF 

Sum  of 
Squares 

1 

Mean 

Square 

F 

Regression 

6 

13.00197 

2.16699 

2072.789 

Error 

57 

0.05959 

0.00105 

Total 

63 

13.06174 

R^2  0.995438 

Adjusted  R'^S 

> 

0.994958 

Ratio  On  Time  -  Plot  of  Ln  Residuals 


Ratio  On  Time  -  Normal  Probability  Plot 


Ratio  On  Time  Function  -  Equation  5 
y=0. 2392  1 9+(0. 1 55938/2  )C +(0.1 48437/2  )G+(0.065938/2)CG 


ANOVA  TABLE 


Source  of 
Variation 

DF 

Sum  of 
Squares 

Mean 

Square 

F 

Regression 

3 

0.81117 

0.27039 

754.795 

Error 

60 

0.02149 

0.00036 

Total 

63 

0.83266 

! 

R^2  0.974187 

Adjusted  R^S 

> 

0.972896 

Ratio  on  Time  -  Plot  of  Residuals 
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Ratio  On  Time  Function  -  Equation  6 
Lnty)=-1. 535428+(0. 647986 /2)C+(0.61 2359/2  )G+(0. 090673/2  )CG 


ANOVA  TABLE 


Source  of  j 

Variation 

DF 

Sum  of  j 
Squares  ' 

Mean 

Square 

F 

Regression  j 

3 

12.84927  I 

4.28309 

1210.546 

1  Error  ! 

60 

0.21229  1 

0.00354 

iTotal  ' 

63 

13.06174  j 

! 

_ j 

iR^2  0.983747 

Adjusted  R^2 

0.982935 
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Residual  Values  (Ln)  -  Equation  6 
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Ratio  Delivered  Function  -  Equation  2 
Ln(y)=-0.664018+(0.03274/2)A+(0.643881/2)C+(0.633737/2)G 
+(0.041 477/2  )S+(0. 088493/2  )CG 
_ ANOVA  TABLE _ 


Source  of  | 

Variation 

DF 

Mean 

Square 

Regression  i 

5 

13.22926 

2.64585 

1909.870 

Error 

58 

0.08035 

0.00139 

Total  1 

63 

13.30961 

,R^2  0.993963 

Adjusted  R^S 

) 

0.993443 

Ratio  Delivered  >  Plot  of  Ln  Residuals 
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Ratio  Delivered  Function  -  Equation  3 
Ln(y)=-0  6640  18+(0.64388  1/2 )C^(0 .633737/2 )G+(0.088493/2)CG 


ANOVA  TABLE 


Source  of 

1  Variation 

DF 

1 

Sum  of 
Squares 

Mean 

! 

Square 

F 

Regression 

i 

3 

13.18458 

4.39486 

2109  084 

Error 

60  i 

0.12503 

0.00208  1 

Total  i 

63 

13.30961 

1 

t 

;  1 

R^2  0.990606 

Adjusted 

) 

0  990137  : 

Ratio  Delivered  •  Plot  of  Ln  Residuals 


Estimated  Results  (Ln)  •  Equation  3 


Ratio  Delivered  Normal  Probability  Plot 
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Residual  Values  (Ln)  •  Equation  3 
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Total  Flying  Hours  Function  -  Equation  2 
Ln(y)-7  163^(0  2  14/2 )A-(-0. 501 /2)C-(-0. 67  1/2)1^(0  607/2)G 
-(-0  462/2)CG 

AXOVA  TABLE _ 


. .  '  '  r 

Source  of 

.Variation  1 

DF 

1  _  , 

Sum  of 

1  Squares 

Mean 

Square  ! 

1 

F  i 

1 

Regression  | 

5 

i  21.26290  1 

4.25258  i 

295  197  i 

j Error  ! 

58 

'  0.83554 

0.01441  1 

i 

iTotal  ! 

63 

1  22  08462  1 
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'r^2  0  962166 

, Adjusted  R^2 
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Total  Flying  Hours  Function  -  Equation  3 
Ln(y )=7 ,163  +(-0 .501/2 )C+(-0 .671/2 )I+(0  607/2 )G+(-0 .46 2 /2 )CG 


ANOVA  TABLE 


jSource  of 

1  Variation 

DF 

1  Sum  of 
Squares  j 

Mean  j 

Square  | 

F  ! 

^  1 

j  Regression 

4 

20.53016 

5.13254 

192,756 

!  Error  i 

59 

.  1.57100  i 

I  0.02663  ' 

1 

Total 

63 

'  22.08462 

!  ' 

I 

1 

:r^2  0  928864 

i  Ad  justed  R^< 

) 

0.924042  i 

Total  Fit  Hrs  -  Plot  of  Ln  Residuals 


Estimated  Results  (Ln)  -  Equation  3 


Total  Fit  Hrs  -  Normal  Probability  Plot 


Residual  Values  (Ln)  •  Equation  3 
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Total  Sorties  Flown  Function  -  Equation  2 
Ln(y)=8,197+(.205/2)A+(-.526/2)C+(.493/2)G 
+(.l  14/2)CI+(-365/2)CG 
_ ANOVA  TABLE 


Source  of 

DF 

F 

Variation 

Regression 

5 

1  1.32754 

2.26551 

228.980 

Error 

58 

0.57385 

0.00989 

Total 

63 

1 1 90955 

,R^2  0.951816 

Adjusted  R^£ 

> 

0.947663 

Total  Sorties  -  Plot  of  Ln  Residuals 
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Total  Sorties  Flown  Function  -  Equation  3 
Ln(y)=8.1 97-(.205/2  )A+(-. 526/2  )C+(.493/2)G+(-.365/2)CG 


ANOVA 

TABLE 

Source  of 

DF 

1  Sum  of 

Mean 

F 

Variation 

Squares 

Square 

Regression 

4 

1  11.11960 

2.77990 

209.867 

Error 

59 

0,78152 

0.01325 

Total 

63 

11.90955 

R^2  0,934379 

lAdjusted  R^< 

> 

0.929930 

Total  Sorties  •  Plot  of  Ln  Residuals 
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Total  Sorties  Flown  Function  -  Equation  4 
Ln(y)=8  197 +(-  526/2  )C+(.493/2)G+(-. 365/2  )CG 


ANOVA 

TABLE 

Source  of 

'  DF 

Sum  of  ! 

Mean  F 

1  Variation 

1 

Squares  i 

^  i  j 

i  Square  i  1 

Regression 

'  3 

I  10  44720 

3.48240  143.802  ' 

:  Error 

1  60 

1.45300  1 

0.02422  i 

Totdl 

1  63 

‘  1  1.90955  i 

1  1  > 

1 

iR^2  0,877997 

j  Ad  justed  R^S 

:  0.871897  ! 
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Productive  Flying  Hours  Function  -  Equation  2 
Ln(y)=5 .46 9 ^(0  7 7 8 /2 )C+(-0 .6 5 7 /2 )I+(0 ,8 5  1 /2  )G 


+(0.124/2  )CK(-0 .547/2  )CG+(-0 . 1 3  6  /2  )IG 
ANOVA  TABLE 


Productive  Fit  Hrs-Plot  of  Ln  Residuals 


Estimated  Results  (Ln)  -  Equation  2 


Prod  Fit  Hrs  -  Normal  Probability  Plot 


-0.15  -0.05  '  0.05  '  0.15  0.^ 

Residual  Values  (Ln)  •  Equation  2 
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Productive  Flying  Hours  Function  -  Equation  3 
Ln(y)=5  469+(0.77  8/2)C+(-0.657/2)I+(0.851/2)G+(-0.547/2)CG 
_ ANOVA  TABLE  _ 


Source  of  ! 

Variation  I 

DF 

Sum  of 
Squares 

Mean 

Square 

F 

_  ! 

Regression  1 

4 

32.96549 

8.24137 

434.984 

Error  i 

59 

1.1 1784 

0.01895 

Total  i 

63 

34  08075 

R^2  0.9672 

Adjusted  R'^S 

> 

0.964977 

Productive  Fit  Hrs-Plot  of  Ln  Residuals 
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Prod  Fit  Hrs  -  Normal  Probability  Plot 
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Productive  Sorties  Function  -  Equation  2 
Ln(y)=6.5  44+(0.5  47/2)C+(0.5a9/2)G 

+(0.107/2)Cr^(-0.122/2)IG+(-0.33/2)CG 


ANOVA  TABLE 


Source  of  ! 

Variation  ! 

Df 

Sum  of  1 
Squares  | 

1 

Mean 

Square 

F 

1 

Regression  ' 

5 

12.50181  1 

2,50036 

380.002 

Error 

58 

0.38163  I 

0.00658 

Total  ! 

63 

12.88112  i 

j 

R^2  0  970373 

Adjusted  R^2 

0.9678186 
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Productive  Sorties  Function  -  Equation  3 
Ln(y)-6.5  44-T-(0.5  47/2)C-r(0.589/2)G^(-0.33/2)CG 
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